Apache SeaTunnel(Incubating) Community Online Meetup lecturer & The topic has been formally solicited ! Under the epidemic , Online communication activities held by the community are still in full swing . Here we sincerely invite the users in the community , Use your power to make the community stronger , Help more people ! Community is more important than code , The community will remember every lecturer who contributed to it !
If you want to contribute your ideas 、 Share your experience 、 Practice your speaking ability , You can scan the QR code below to sign up , We will be in 7 Contact you within working days , Before that, you can learn about the sharing guests in Meetup Harvest in .
01 Apache SeaTunnel(Incubating)Meetup What is it? ?
Apache SeaTunnel(Incubating) It's a distribution 、 High performance 、 Easy to expand 、 For massive data ( offline & real time ) Synchronized and transformed
Data integration platform
.
2021 year 12 month 9 Japan ,SeaTunnel Officially passed the world's top open source organization Apache The voting resolution of the software foundation , The outstanding performance that passes by all votes becomes Apache NREL incubator subcontract ! It's also Apache The first data integration platform project born in China in the foundation .
Meetup The event was held by SeaTunnel Community sponsored , Average
Once a month
, Mainly for developers in the field of data synchronization , Share through the practice of front-line engineers , Help community developers improve their skills and knowledge , Create greater value for the global community users . At home Meetup Has succeeded continuously 5 site , Attract more than
5000+ Technology enthusiasts
To participate in .
02 What needs to be prepared ?
Apache SeaTunnel (Incubating) Our aim is to
High-quality 、 valuable 、 Industry frontier and hands-on practice
Share with you , Every lecturer is us Apache SeaTunnel (Incubating) The representative of the , The professionalism you showed on stage , It will also drive more people in the community to forge ahead .
03 Meetup Lecturer's rights and interests
All involved Meetup Lecturer of the sharing meeting , Will be recorded in
Non code contribution
.Apache In the official definition of the project ,Committer The selection is multifaceted . Contribution to the project except code 、 The time of document modification , Preach the project 、 organization Meetup And other official activities will be recorded as contributions , You can do it this way
Become Committer
.
Rights and interests can be divided into the following items :
The content of the live speech will be compiled by the community operation students , Published in
Apache SeaTunnel (Incubating)
Official official account and other platforms for publicity .
04 Instructor registration channel
Lecturer recruitment registration link :
http://whaleops.mikecrm.com/nnueRr0
If you are right about
Meetup Speaker
Have any questions , You can contact wechat assistant ( WeChat ID :seatunnel1) Or scan the QR code above , Submit your Proposal ! We look forward to your discussion 、 Hear your voice !
05 Topic direction
Just like the open source tenet we all believe in ——
to open up 、 inclusive
equally , On the choice of topics , As long as you want to share the topic with Apache SeaTunnel (Incubating) relevant , We'd love to hear your voice . Some recommended topics listed below , For your reference only .
06 In the past Meetup grand occasion
07 Previous wonderful sharing topics
Create the ultimate silky experience of online games ,Apache SeaTunnel(Incubating) In the design of Youzu network data access platform
Game big data era , Data plays a vital role in the smoothness and playability of the game . alike , This also puts forward higher and higher requirements for the richness and real-time of game data . In the process of searching, we use many types of data synchronization 、 Migration tools , But there are still some actual needs that cannot be well supported . For example, in the game crowd portrait scene , We need to calculate the crowd label width table from Hive Scheduled scheduling import to StarRocks, to BA The platform provides crowd query 、 analysis 、 The function of circle selection , After various comparisons, we chose Apache SeaTunnel (Incubating).
Apache SeaTunnel(Incubating) Decoupling from the computing engine , restructure API What have we done
Lizongwen, senior engineer of Moby Dick open source, is using Apache SeaTunnel (Incubating) In the process of , He found out Apache SeaTunnel (Incubating) There are four major problems :Connector More implementation times 、 The parameters are not uniform 、 It is difficult to support multiple versions of the engine and the problem of difficult engine upgrade . In order to solve the above problems , Li Zongwen put his goal on Apache SeaTunnel (Incubating) Decouple from the computing engine , Reconstruct among them Source And Sink API, Improved development experience .
Ten billion level data synchronization , How to base on SeaTunnel Of ClickHouse Realization ?
For the import of 10 billion batch data , Conventional JDBC The performance of this method in some massive data synchronization scenarios is not satisfactory . In order to provide faster write speed ,Apache SeaTunnel(Incubating) Just released in 2.1.1 It is provided in the release ClickhouseFile-Connector Support for , In order to realize the Bulk load Data writing .
Bulk load Refers to the synchronization of massive data to the target DB in , at present SeaTunnel Data synchronization to ClickHouse in .Apache SeaTunnel(Incubating) Contributor Fan Jia explained in detail ClickHouseFile The specific implementation principle and process of efficient processing of massive data .
Operation and maintenance is difficult , Iteration difficulty ,oppo Intelligent recommendation sample center application SeaTunnel How to realize intelligent recommendation online learning ?
oppo Intelligent recommendation sample center introduces Apache SeaTunnel(Incubating) Business background , It is to meet the needs of online learning based on Intelligent Recommendation in the context of push search square . The whole push search platform can support three main scenarios , They are recommended 、 Search and advertising . The platform carries various businesses , Including the software store 、 information flow 、 Game center, etc . However, due to the early adoption of chimney development , As a result, there are 10 Multiple sets of business logic ,200 Multiple data processing tasks , The language is also very complicated . After studying various big data integration platforms , We finally chose Apache SeaTunnel(Incubating) .
Participate in Meetup The process of knowledge acquisition is not only an increase in the amount of knowledge , It is also an opportunity for public exposure and self-expression .Apache SeaTunnel(Incubating) Community Meetup As a vertical 、 Technical activities , Most of the participants are industry leaders and practitioners , Be able to talk freely in front of everyone , Show your eloquence , It will also help to build personal technical influence , At the same time, you can make a group of like-minded friends , Hear the front line in the industry , The most valuable content , Never miss .
Apache SeaTunnel
// Keep in contact //
WeChat ID : SeaTunnel
To grow with the community !
Apache SeaTunnel(Incubating)
It's a distribution 、 High performance 、 Easy to expand 、 For massive data ( offline & real time ) Data integration platform for synchronization and transformation .
Warehouse address :
https://github.com/apache/incubator-seatunnel
website :
https://seatunnel.apache.org/
Proposal:
https://cwiki.apache.org/confluence/display/INCUBATOR/SeaTunnelProposal
Apache SeaTunnel(Incubating) 2.1.0 Download address :
https://seatunnel.apache.org/download
We sincerely welcome more people to join !
Can enter Apache The incubator ,SeaTunnel( primary Waterdrop) The new journey has just begun , But the development of the community needs more people to join . We believe that , stay **「Community Over Code」
( Community greater than code )、
「Open and Cooperation」
( Open collaboration )、
「Meritocracy」**( Elite management )、 as well as 「** Diversity and consensus decision making 」** etc. The Apache Way Under the guidance of , We will usher in a more diversified and inclusive community ecology , Technological progress brought by the spirit of co construction and open source !
We sincerely invite all partners who are interested in making local open source based on the world to join SeaTunnel Contributor family , Build open source together !
Submit questions and suggestions :
https://github.com/apache/incubator-seatunnel/issues
Contribution code :
https://github.com/apache/incubator-seatunnel/pulls
Subscribe to community development mailing lists :
Develop mailing lists :
Join in Slack:
https://join.slack.com/t/apacheseatunnel/shared_invite/zt-123jmewxe-RjB_DW3M3gV~xL91pZ0oVQ
Focus on Twitter:
https://twitter.com/ASFSeaTunnel
原网站版权声明
本文为[InfoQ]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/188/202207071327159608.html