Data Engineer
INBLR02 - Bangalore - Milesstone Buildcon, India
INR 2520K-3465K (estimate) Senior-level Full Time
Tasks
- Apply infrastructure as code patterns for multi tenant deployments
- Automate data engineering operations
- Build streaming and batch pipelines
- Create reusable data engineering standards and onboarding scaffolding
- Design ingestion frameworks for structured and unstructured data
- Develop data transformation logic with SQL and Spark
- Enforce naming standards partitioning and schema evolution
- Handle deduplication windowing and watermarking
- Implement lakehouse architecture with Delta Lake
- Instrument pipelines with quality checks and cost visibility
- Integrate observability tools for reliability and traceability
- Manage metadata ownership PII classification and data lineage
- Optimize query performance for real time and historical data
- Support deployment workflows with GitHub Actions and Terraform
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | Amazon EMR | Amazon S3 | Amazon Web Services | Apache Spark | Batch Processing | DBT | Data Lineage | Data pipeline | Data pipeline optimization | Delta Lake | Docker | GitHub Actions | Grafana | Infrastructure as Code | Kubernetes | Observability | OpenLineage | OpenMetadata | Pipeline Optimization | Prometheus | Python | SQL | SQLMesh | Streaming Data | Terraform | Web Services | “as-code”
Education
N/A
Roles
Related jobs
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Platforms | Data Modeling | Data Warehouse | Data WarehousingMid-level Full TimeHyderabad, HDC4A, India7h ago
-
Mid-level Full TimeBengaluru, BDC11A, India7h ago
-
Software Engineer INR 1068K-1910KAgile | Angular | Azure | CI/CD | DatabricksCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningMid-level Full TimePune, MH, India11h ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R16h ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R17h ago
-
Data Engineer INR 1500K-2000KAWS Lambda | Amazon Redshift | Amazon S3 | Azure Data | Azure Data FactoryMid-level Full TimeAhmedabad, 380015, India17h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R17h ago
-
QA Engineer INR 240K-360KDBT | Data Quality | Data Warehousing | Dimensional Modeling | ETLOff hour support on rotation basisEntry-level Full TimePune City, India17h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-5000KComputer Vision | Deep learning | FP16 | GPU Acceleration | Human pose estimationSenior-level Full TimeMaharashtra, Pune, India18h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Mid-level Full TimeIN-KA-Bangalore18h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …18h ago
-
Mid-level Full TimeBangalore - Karnataka, India - Kalyani …18h ago
-
Business glossary | Data Catalog | Data Contracts | Data Lineage | Data ModelingAsync first | Flexible overlap hours | RemoteSenior-level Full TimePune, Maharashtra, India19h ago
-
Senior Data Engineer INR 3000K-4000KADLS Gen2 | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, Maharashtra, India19h ago
-
Senior Data Engineer INR 2516K-3356KAirflow | Amazon Athena | Apache Hive | Artificial Intelligence | BigQuerySenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior Software Engineer INR 3000K-4000KAPI Integration | AWS | AWS Lambda | AWS Step Functions | AlertingSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Associate AI/ML Engineer INR 1800K-2800KBigQuery | Cloud Functions | Cloud platform | Dataflow | Google CloudPersonal growth | Professional growthMid-level Full TimeBnegaluru, Pune20h ago
-
Apache Spark | Data Modeling | Data Quality | Data Visualization | Data WarehousingAccessibility support | Career growth | Fully remote | Inclusive workplace | Work-life balanceSenior-level Full TimeIndia R20h ago
-
Senior Database Engineer INR 2520K-3380KAerospike | Azure | Azure Cosmos | Azure Cosmos DB | Azure DataOn-call support | Relocation assistance | Rotational shifts 24x7Senior-level Full TimeBengaluru, KA, IN21h ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India21h ago
-
Senior Software Engineer-Python INR 3000K-4000KAccess Control | Alerting | Apache Spark | Azure | CI/CDBirthday off | Flexible working hours | Personal flexibilitySenior-level Full TimeGurgaon22h ago