Data Engineer
Shanghai, SH, CN, 200001
GCIO - Asia & Middle East Technology
Our GCIO organisation plays a critical role for the bank. This team partners with the businesses to build the platforms, systems, and products that our customers use every day. We keep people’s money and data safe, and are at the forefront of driving innovation for our businesses, customers, and colleagues.
We are currently seeking an experienced professional to join our team.
In this role, you will:
- Engineer the data transformations and analysis for the local business requirements, based on the strategic data platform and the local built data applications.
- Develop the batch processing and near real-time/real-time stream processing on-prem or Alicloud.
- Architecture design for Low latency, High through-put, auto scaling application.
- Familiar with the data modeling methodology like 3NF or star schema, has the experience on developing enterprise level data models
- Implementing an end-to-end data service, assessing the operations and non-functional needs clearly.
- Guide developers in implementing best-of-breed technical solutions based on agreed technical design, adopting industry standard development patterns and methodologies (including continuous integration and automated unit and integration testing)
- Mentor and Coach the data engineering and SME talent to realize their potential and build a high-performance team.
- Manage complex end to end functional transformation module from planning estimations to execution.
- Improve the platform standards by bringing in new ideas and solutions on the table.
To be successful in the role, you should meet the following requirements:
Education
- Bachelor’s degree (or above) in computer science, Information Technology, Data Science or a related field.
Experience
- 12+ years of experience in data engineering technology and tools.
- Must have experience with Python/ Scala based implementations for enterprise-wide platforms.
- Complex state-full processing of events with partitioning for higher throughputs.
- Experience in Ali Cloud, be familiar with cloud services like MaxCompute, Dataworks, Hologres, OSS and ECS etc.
- Hands-on coding capabilities in distributed computing framework like Spark or Flink, data storage like HDFS/NoSQL, data processing like ETL/Python, data governance like metadata management or data lineage
- Have dealt with fine-tuning the throughputs and improving the performance aspects on data pipelines.
- Experience with analytical data store optimizations, querying and managing them.
- Experience with alternate data engineering tools (Apache Flink, Apache Spark etc).
- Reason and have an ability to convince the stake holders and wider technology team about your decisions.
- Set highest standards of integrity and ethics and lead with examples on technology implementations.
Technical Skill
- Strong knowledge of AliCloud Data services (e.g., MaxCompute, DataWorks, Hologres and OSS etc.) and their application in data engineering.Cloud certified candidate is preferred.
- Experience and knowledge of Bigdata data processing in batch mode and streaming mode, proficient in Bigdata eco systems, e.g. Hadoop, HBase, Hive, MapReduce, Kafka, Flink, Spark, etc.
- Familiarity with SQL, Java or Python for data manipulation on Cloud/Bigdata platform.
Language
- Fluency in English and Mandarin Chinese (written and spoken) is required.
Cultural Fit
- Understand Chinese business environment and familiar with cross-location, multiculture collaboration in an international organization.
Preferred Qualification
- Familiarity with Chinese financial regulators (e.g. NFRA, PBoC, CFETS) and their technology-related requirements.
- Proven success in leading large-scale data platform projects in the Finance sector.
- Strong project management skills, with experience overseeing cross-functional initiatives that align technology strategy with business outcomes.
You’ll achieve more when you join HSBC.
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within and inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.