Skip to main content

Data Engineer

5 day weekGenerous PTOOnsite · Hyderabad, India

Career Category

Engineering

Job Description

Data Engineer :

Job Description

As a Data Engineer supporting data strategy, you will design, build, and maintain scalable data pipelines that integrate data from legal systems into Amgen’s enterprise data fabric.

You will enable high-quality, governed datasets that support analytics, reporting, and emerging AI/ML use cases for Legal and Compliance teams.

This role requires strong hands-on engineering skills, familiarity with modern data platforms (e.g., Databricks), and the ability to work closely with Legal stakeholders, Data Architects, and AI/Analytics teams.

Key Responsibilities

Data Engineering & Pipeline Development

  • Build and optimize databricks pipelines using modern frameworks (Databricks, Spark)
  • Implement reliable, scalable, and production-ready data pipelines using engineering best practices, monitoring, and automated validation frameworks
  • Integrate structured and unstructured legal data into the enterprise data fabric
  • Ensure reliability, scalability, and performance of data pipelines

Databricks & Modern Data Platform

  • Develop pipelines using Databricks (Delta Lake, Spark, notebooks)
  • Implement data transformation and orchestration workflows
  • Support migration and modernization of legacy data solutions to cloud-native platforms
  • Contribute to reusable data engineering patterns and components
  • Optimize Delta Lake and Spark workloads for scalable, cost-efficient, and high-performance enterprise data processing

Data Quality, Governance & Compliance

  • Implement data quality checks, validation rules, and monitoring
  • Implement governance, lineage, and security controls for sensitive legal and compliance datasets
  • Ensure compliance with data governance, privacy

Collaboration & Delivery

  • Work with Legal stakeholders to understand data needs and translate into technical solutions
  • Partner with Data Architects to align with enterprise data fabric strategy
  • Participate in Agile development processes (sprint planning, estimation, delivery)
  • Document pipelines, models, and technical decisions

Basic Qualifications

  • Master's or Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
  • 5-8 years of experience in data engineering or related technical role

Must-Have Technical Skills

  • Strong experience with SQL and relational databases
  • Programming experience in Python (required), PySpark preferred
  • Hands-on experience with Databricks / Apache Spark
  • Understanding of data modeling and data warehousing concepts

Preferred / Strategic Skills (Aligned to Future Data Strategy)

  • Certification:
    • Relevant certifications in Databricks, cloud platforms (AWS/Azure/GCP), or modern data engineering technologies are a plus
  • Experience with:
    • Delta Lake / Lakehouse architectures
    • Data Fabric / Data Mesh concepts
  • Familiarity with:
    • Streaming data (Kafka, event-driven pipelines)
    • Data orchestration tools (Airflow, Databricks Workflows)
  • Exposure to:
    • AI/ML data pipelines and feature engineering
    • Unstructured data processing
  • Understanding of:
    • Data governance frameworks and cataloging tools
    • Security and privacy controls for sensitive data

Functional Skills

  • Strong problem-solving and analytical thinking
  • Ability to work with large, complex datasets
  • Effective communication with both technical and non-technical stakeholders
  • Ability to operate in a fast-paced Agile environment

.