Provide SFTP connection for Amazon S3

Amazon S3 or Simple Storage Service, It's a low cost 、 Cloud based object storage services , It passes through reasonable 、 Pay as you go pricing provides users with virtually unlimited storage space .S3 The economics of storage 、 Availability and flexibility , Make organization dependent S3 To deal with what you can imagine , From point in time backup to business data backup and storage of everything in between .

Many organizations seek to take advantage of SFTP As a simple file transfer mechanism , Transfer data from enterprise applications to Amazon S3.

Like thousands of organizations and teams around the world , You can use S3 As a central repository , Store all the data in one place , Used in a series of programs ：

• Back up your data and keep historical versions of the data
• adopt AWS Cloud platforms within the ecosystem share files across the organization
• Store audit logs
• Support data governance
• adopt Amazon QuickSight And other tools to provide access to analytical data
• Processing from business intelligence software （ Such as Hadoop or Databricks） Distributed query

originally EDI System ：SFTP To S3 Massive Integration

SFTP It is the most common secure file transfer protocol used today . Based on powerful SSH encryption ,SFTP Provides a simple channel to protect file transfer between systems . what's more ,SFTP Almost universally available . trace back to 1990 Late S ,SFTP Function in Linux、Unix and Mac Generally available on the system , And the client application can also be in Windows Easy access on the system .

With wide availability and strong security ,IT The person in charge has been passing SFTP Script and automate file transfers . They naturally want to support the same interface to push files to Amazon S3. actually , It's not that simple . because S3 Technically, it is object storage rather than file storage , Therefore, S3 The protocol of interaction is different from using traditional file system . So what is the solution ？

Amazon through its AWS Transfer Family Services provide SFTP To S3 Pay integration for , but SFTP Interface is an additional service , Charge by the hour and generate data surcharges . This will make AWS SFTP Services for the need for always on-line or mass file transfers , Become very expensive .

The good news is , You can use knowledge and action EDI System and other intermediate managed file transfer service platforms to avoid these costs and reduce file transfer costs .

With the help of knowledge and action EDI System , You can do it easily SFTP-S3 Automate processes and handle unlimited file transfers , Without increasing costs . Anything that can be connected to SFTP Everything can be connected to knowing and doing EDI System , originally EDI The system will seamlessly push files to S3. Besides , originally EDI The advanced mapping and transformation functions of the system support dynamic data processing and data transformation , This is moving data to S3 It is very useful for long-term storage .

Use knowledge and action EDI System building intelligence SFTP Workflow and transformation

Besides being economical , originally EDI The system also provides enhanced data conversion and automation functions , To help you simplify and manage SFTP-S3 File transfer . As the center of managed file transfer , originally EDI The system can also help you transfer all files to S3、SQL Server And all other noteworthy database systems .

automation

By providing conditional logic 、 Drag and drop integration 、Webhook and API management , originally EDI The system can be easily realized SFTP To S3 Seamless automation and scheduling of workflows .

Notification and monitoring

When there are any obstacles in the file transfer process , originally EDI The system's notification and monitoring tools will automatically let you know . You can set up custom email notifications , So that your system administrator can respond to any interruption in real time .

Automatic retry

originally EDI The system supports automatic retrying , Therefore, temporary network interruption will not cause trouble . originally EDI The system only reports documents as transferred after guaranteed delivery .

Custom business logic

Quickly bring intelligence and process automation to your business workflow . originally EDI The system provides an intuitive visual interface , Therefore, non-technical personnel can quickly create file transfer data flow through our drag and drop codeless workflow designer . You can also leverage advanced developer capabilities to simplify the most complex workflows . The operation is flexible and simple , Reduce complexity .

Data conversion 、 Inquire about 、 lookup 、 Merge

originally EDI The system provides you with easy-to-use tools , So you can move a specific subset of the data to S3 in , You can even convert them from one file format to another in the process . With the help of knowledge and action EDI System , You can use Webhook or API Request to query data from any underlying data source or database , Find data in a given document , Use conditional logic to apply data transformations , Then move it to S3. You can even merge from multiple tables 、 Information about the data source or document line , Then transfer it to S3 Before the logical processing of the data .

Versatile ports

Amazon S3 Far from being the only place you need to move files . Use our ports to create powerful workflows 、 Automation of business processes, etc .

• Box
• Dropbox
• Google Drive and Google Storage
• OneDrive
• Oracle DB
• SQL Server
• S3

How to use knowledge and action EDI The system transfers files from SFTP Transferred to the S3?

Use knowledge and action EDI The system settings are from SFTP To S3 Automatic file transfer for includes five simple steps .

1. In knowing and doing EDI Settings in the system SFTP Server

First host a SFTP Server, Remote clients can use this server to send files to Zhixing EDI Processing in the system . To start and run this server , Just use knowing and doing EDI The system configuration file page configures the necessary properties , For example, port 、 Server certificate 、 Root directory and logs .

2. Set user credentials to connect to SFTP server

Set up SFTP Clients can be used to connect to SFTP User credentials for the server . take SFTP Drag the server port to Zhixing EDI Configure user credentials for a remote user in the system workspace and using the settings panel . Besides , Use this settings panel to specify authentication mode and set send and receive subfolders ; Then know what to do EDI The system will automatically route the file to the workflow .

3. Set up SFTP server

Now is the time to SFTP The client points to SFTP The server . Just put the SFTP Drag and drop the client connector into your workspace , Configure the server and port , Then enter the user credentials you created in the previous step . Specify the folder where the server wants to receive files / Path to subfolder . The system will automatically prompt you to test the connection .

4. Select and set Amazon S3 port

take S3 Drag and drop the port into the workflow under the workspace . Enter your S3 Access the credentials and specify what you want to know and do EDI The storage place or folder where the system uploads files / A folder .

5. Testing process

Your SFTP To S3 The workflow is now complete . Use the test file option to test the configuration , This option allows you to track files through data flow .

Learn more about EDI Related information , Comments or personal messages are welcome .