当前位置:网站首页>Era5 reanalysis data download strategy
Era5 reanalysis data download strategy
2022-07-06 02:53:00 【windawdaysss】
Preface
ERA5 It's the fifth generation ECMWF Atmospheric reanalysis of global climate data , The first part of the dataset is now publicly available (1959- Now? ),ERA5 Data provide hourly atmosphere 、 Estimates of terrestrial and oceanic climate variables .
Download process details
One 、 Download website description and registration
The download website is a foreign website :https://cds.climate.copernicus.eu/cdsapp#!/home, Follow the steps in the figure below ( The network is not good, there may be a bit of a card , Just drink some water and wait ):
Check the list of various data found on the right , Choose the data you want to download , If it is not clear whether the selected data is correct , You can click in to have a look , such as , I choose the following data set :
After entering the point , default overwiew The composition variables of the data set and the introduction of the data will be introduced in the following figure . When you decide that it is the data you want , open overwiew After Download data that will do .
There are product types Product type,Variable,Pressure level,year…… Options such as , Choose what you need . Pull to the bottom to select an area , The default is global data , If you want to locate the area you want , For example, China , The following settings can be made , Generally, the data format is NetCDF that will do .
There is show API request, The point is python Script , There is... On the right login/register to submit request, You need to register or login :
Register as required , Sign in .
Two 、 Download computer configuration
Click the login user name at the top right , There is API key
In the following format , Put it in the computer C:\Users\ Your users \ Next . Build one specifically txt Text , Copy the code in , Save as .cdsapirc file , Select all formats .
url: https://cds.climate.copernicus.eu/api/v2
key: UID:API key
3、 ... and 、 Batch download settings
- IDM yes “Internet Download Manager” For short , Is a very powerful download software .
- Install package Links :https://pan.baidu.com/s/1iojjYOg_Y2NdMcmJahz_pw, Extraction code :dimq, Version is v6.36 Build 7, Resources come from carrot week .
- After downloading the installation package, open the folder , double-click “idman636build7.exe” Start installation IDM, Keep clicking forward , Install to the default location .
- Copy the cracked patch to IDM Installation directory ( The default location is “C:\Program Files (x86)\Internet Download Manager” ), Double click to run the crack patch , Click on “ Crack IDM”, After cracking, click “ complete ” Close the patch .
Be careful : Don't update IDM, Otherwise, the software may not be available . - Yes IDM To configure , Open software , Find... In the main interface “ Options ”, open ;
- In the options window , find “ Connect ” page , modify “ Connection type / Speed ” by “ High speed connection : LAN /Wi-Fi/ The mobile network 4G/ other ”, modify “ Default maximum connections ” by 16, Click on “ determine ” Complete the configuration .
Four 、 Use python Script batch download
install cdsapi Third party Library .
pip install cdsapi
import cdsapi
import calendar
from subprocess import call
def idmDownloader(task_url, folder_path, file_name):
""" IDM Downloader :param task_url: Download task address :param folder_path: Storage folder :param file_name: file name :return: """
# IDM The installation directory
idm_engine = "C:\\Program Files (x86)\\Internet Download Manager\\IDMan.exe"
# Add task to queue
call([idm_engine, '/d', task_url, '/p', folder_path, '/f', file_name, '/a'])
# Start task queue
call([idm_engine, '/s'])
if __name__ == '__main__':
c = cdsapi.Client() # Create user
# Data information dictionary
dic = {
'product_type': 'reanalysis', # The product type
'format': 'netcdf', # data format
'variable': 'relative_humidity', # Variable name
'year': '', # year , Set to null
'month': '', # month , Set to null
'day': [], # Japan , Set to null
'pressure_level': [
'1', '2', '3',
'5', '7', '10',
'20', '30', '50',
'70', '100', '125',
'150', '175', '200',
'225', '250', '300',
'350', '400', '450',
'500', '550', '600',
'650', '700', '750',
'775', '800', '825',
'850', '875', '900',
'925', '950', '975',
'1000'],
'time': [ # Hours
'00:00', '01:00', '02:00', '03:00', '04:00', '05:00',
'06:00', '07:00', '08:00', '09:00', '10:00', '11:00',
'12:00', '13:00', '14:00', '15:00', '16:00', '17:00',
'18:00', '19:00', '20:00', '21:00', '22:00', '23:00'
],
'area': [60, 70, 0, 140],
}
# Download in batches through circulation 2016 Year to 2020 Data of all months of the year
for y in range(201, 2021):
for m in range(1, 13): # Traverse the month
day_num = calendar.monthrange(y, m)[1] # According to month and year , Get the number of days in the current month
# Will be 、 month 、 The day is updated in the dictionary
for d in range(1, day_num + 1):
dic['year'] = str(y)
dic['month'] = str(m).zfill(2)
dic['day'] = str(d).zfill(2)
r = c.retrieve('reanalysis-era5-pressure-levels', dic) # File downloader
url = r.location # Get the file download address
path = r'C:\downloadData\relative_humidity' # Storage folder
filename = 'era5.relative_humidity.' + str(y) + str(m).zfill(2) + str(d).zfill(2) + '.nc' # file name
idmDownloader(url, path, filename) # Added to the IDM Download
5、 ... and 、 explain
After running the script in four , There will be queued, It means waiting in line , here , Click... In the lower right corner of the page that selects the data format submit form, The following will appear , Wait in line , The state becomes in progress 了 , Processing download .
By practice , Usually in the morning during the day 10 From 00 to 34 p.m , The download speed is relatively fast , in addition , The weekend will also be better . After all, it's a foreigner's website , They will definitely be smoother when they are resting .
END
Reference material
边栏推荐
- PMP practice once a day | don't get lost in the exam -7.5
- [Yunju entrepreneurial foundation notes] Chapter II entrepreneur test 6
- Patch NTP server at the beginning of DDoS counterattack
- 2.13 simulation summary
- [Yunju entrepreneurial foundation notes] Chapter II entrepreneur test 21
- Elimination games
- PMP每日一练 | 考试不迷路-7.5
- 4. File modification
- 微服务注册与发现
- Prototype design
猜你喜欢
4. File modification
C language - Blue Bridge Cup - promised score
Modeling specifications: naming conventions
【若依(ruoyi)】启用迷你导航栏
Httprunnermanager installation (III) - configuring myql Database & initialization data under Linux
[Yunju entrepreneurial foundation notes] Chapter II entrepreneur test 12
ReferenceError: primordials is not defined错误解决
[ruoyi] set theme style
Reverse repackaging of wechat applet
[Chongqing Guangdong education] higher mathematics I reference materials of Southwest Petroleum University
随机推荐
"Hands on learning in depth" Chapter 2 - preparatory knowledge_ 2.3 linear algebra_ Learning thinking and exercise answers
Day 50 - install vsftpd on ceontos6.8
Six stone management: why should leaders ignore product quality
【若依(ruoyi)】启用迷你导航栏
Redis cluster deployment based on redis5
What should we pay attention to when using the built-in tool to check the health status in gbase 8C database?
Qt发布exe软件及修改exe应用程序图标
My C language learning record (blue bridge) -- on the pointer
[Yunju entrepreneurial foundation notes] Chapter II entrepreneur test 10
Huawei, H3C, Cisco command comparison, mind map form from the basic, switching, routing three directions [transferred from wechat official account network technology alliance station]
Communication between microservices
07 单件(Singleton)模式
ReferenceError: primordials is not defined错误解决
Looking at the trend of sequence modeling of recommended systems in 2022 from the top paper
Pat 1084 broken keyboard (20 points) string find
C语言sizeof和strlen的区别
[kubernetes series] learn the exposed application of kubernetes service security
Universal crud interface
CSP date calculation
[ruoyi] enable Mini navigation bar