Data Engineer/Consultant Specialist
Pune, MH, IN, 411006
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist
In this role, you will:
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build and optimize batch and streaming data processing solutions using Python and PySpark.
- Work with large datasets on distributed data platforms to ensure reliability and performance.
- Collaborate with data analysts, data scientists, and software engineers to deliver high-quality data solutions.
- Develop reusable, efficient, and well-documented code for data ingestion, transformation, and validation. Troubleshoot and resolve data quality, performance, and pipeline reliability issues.
- Integrate data from multiple sources, including APIs, databases, and cloud storage systems.
- Support data modeling, data warehousing, and analytics use cases. Participate in technical design discussions, code reviews, and architecture decisions.
- Follow best practices for security, scalability, testing, and monitoring.
To be successful in this role, you should meet the following requirements:
- 5–8 years of experience in data engineering, backend development, or related roles.
- Strong proficiency in Python for data processing and automation.
- Hands-on experience with PySpark for distributed data processing.
- Solid understanding of SQL and relational database concepts.
- Experience building ETL/ELT pipelines and working with structured and semi-structured data.
- Familiarity with big data ecosystems such as Hadoop, Spark, Databricks, or similar platforms.
- Experience with version control tools like Git, CI/CD pipelines, and containerization such as Docker.
- Good problem-solving, communication, and collaboration skills. Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field, or equivalent experience.
You’ll achieve more when you join HSBC.
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSBC Software Development India