Senior Tech Lead - Data Engineering / Consultant Specialist
Hyderabad, TG, IN, 500032
Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist
In this role, you will:
- Own the technical roadmap for RDH ingestion, transformation, and distribution on GCP.
- Set and enforce engineering standards (coding, testing, DevSecOps, release management, documentation, operational readiness).
- Provide hands-on technical leadership via design reviews, code reviews, mentoring, and pairing.
- Design, build, and optimise Dataflow/Apache Beam pipelines for internal/external reference datasets (batch and/or streaming).
- Drive performance, reliability, and cost optimisation across pipelines (e.g., autoscaling, efficient I/O patterns).
- Lead the transformation layer in BigQuery using DBT (modelling standards, macros, tests, documentation, lineage) and implement data quality controls (tests, reconciliation, anomaly detection).
- Ensure reliable data delivery to consumers via APIs, SFTP, BigQuery Authorised Views; define/meet SLAs/SLOs and resolve integration issues.
- Own production stability: act as senior escalation, lead major incident triage/communication, drive RCA and preventative actions, and improve monitoring/alerting and runbooks—while embedding security/risk/compliance by design (IAM least privilege, encryption, auditability, segregation of duties).
To be successful in this role, you should meet the following requirements:
- Strong hands-on GCP experience, specifically BigQuery, Cloud Storage, Pub/Sub, IAM.
- Proven delivery of Dataflow / Apache Beam pipelines (batch and/or streaming) in Java and/or Python.
- Strong SQL skills with BigQuery performance optimisation (partitioning/clustering, cost/performance tuning, troubleshooting).
- Solid DBT experience (modelling patterns, tests, documentation, environments, deployment).
- Experience with workflow orchestration using Cloud Composer / Apache Airflow.
- Working knowledge of CI/CD for data engineering (Git-based workflows, automated testing, release controls).
- Strong production operations capability: monitoring/alerting, incident management, RCA, runbooks, SLO/SLA mindset.
- Demonstrated tech leadership: design/code reviews, mentoring, stakeholder management, and delivery in a controlled/regulatory environment.
You’ll achieve more when you join HSBC.
www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSBC Software Development India