南湖人才网_南湖招聘网_求职找工作平台

We're looking for a new colleague to join ZF at our location in Xuhui, Shanghai.Your tasks:Understand business needs and challenges around big data integration, data engineering, and data operations to build end-to-end data pipelines. Assemble large, complex data sets, developing data ingestion, data processing and analytical pipelines for big data, and data warehouse solutions to meet functional / non-functional requirements.Orchestrate, Automate and maintain, and testing of Data Pipelines. Expanding and optimizing our data and data pipeline architecture, as well as optimizing data collection and data flow. Development of data tools for exploration and monitoring that support downstream teams to build data products.Work with value centers and business partners, to assist with data-related technical issues and support the end-to-end production operations of data pipelines.Your profile:Good experience on cloud platform for example Azure platform services, like Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Python and Pyspark3 years-experience in data related filed.Data ingestion and processing Pipelines with their respective systems into the Data Lake environment Support