Lead Software Engineer, Data Engineering
at Valgenesis
Chennai, onsite, senior, full time, 6–12 years
posted 19 Nov 2025
- C#
- PostgreSQL
- Kafka
- MLflow
- Tableau
- Delta Live Tables
- Apache Airflow
- PyTorch
- GitHub Actions
- Docker
- Event Hubs
- MySQL
- Azure Data Lake
- Cosmos DB
- Azure DevOps
- Python
- TensorFlow
- Java
- Azure
- Power BI
- Scala
- SQL Server
- Unity Catalog
- SQL
- Azure Data Factory
- Service Bus
- dbt
- MongoDB
- Databricks
- Apache Superset
- Kubernetes
About the role
Posted: 2025-11-19
About ValGenesis ValGenesis is a leading digital validation platform provider for life sciences companies. ValGenesis suite of products are used by 30 of the top 50 global pharmaceutical and biotech companies to achieve digital transformation, total compliance and manufacturing excellence/intelligence across their product lifecycle. Learn more about working for ValGenesis, the de facto standard for paperless validation in Life Sciences: https://www.valgenesis.com/about
What you would do
- Architect, Design, develop, and maintain data ingestion, transformation, and orchestration pipelines (batch and real-time).
- Build and optimize data Lakehouse architectures using Azure Synapse, Delta Lake, or similar frameworks.
- Integrate and manage structured and unstructured data sources (SQL/NoSQL, files, documents, IoT streams).
- Develop and operationalize ETL/ELT pipelines using Azure Data Factory, Databricks, or Apache Spark.
- Collaborate with Data Scientists to prepare and serve ML-ready datasets for model training and inference.
- Implement data quality, lineage, and governance frameworks across pipelines and storage layers.
- Work with BI tools (Power BI, Superset, Tableau) to enable self-service analytics for business teams.
- Deploy and maintain data APIs and ML models in production using Azure ML, Kubernetes, and CI/CD pipelines.
- Ensure scalability, performance, and observability of data workflows through effective monitoring and automation.
- Collaborate cross-functionally with engineering, product, and business teams to translate insights into action.
- Mentor junior team members and review their work
What they are looking for
- Experience: 6 to 12 years in Data Engineering or equivalent roles.
- Programming: Strong in Python, SQL, and at least one compiled language (C#, Java, or Scala).
- Databases: Experience with relational (SQL Server, PostgreSQL, MySQL) and NoSQL (MongoDB, Cosmos DB) systems.
Read from jobs.lever.co, last seen 4d ago.