Data Engineer
Tasks
- Aggregate and combine data from multiple sources
- Analyze data pipes and systems to identify improvements
- Assist with proofs of concept
- Build automated processes to measure data quality failures and errors
- Collaborate on dimensional data modeling with Kimball practices
- Design data quality controls and thresholds
- Develop data quality measurement and reporting processes
- Develop support and remediation processes
- Profile data sources and identify ETL quality issues
- Tune CI CD framework using Azure DevOps
Perks/Benefits
- N/A
Skills/Tech-stack
Analysis Services | Azure | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Catalog | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | DAX | Data Catalog | Data Factory | Data Lake Storage | Data Quality | ETL | Microsoft SQL | Microsoft SQL Server | Power BI | Powershell | Python | SQL Server | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India2h ago
-
Senior-level Full TimeBangalore, Karnataka, India2h ago
-
Senior-level Full TimeBangalore, Karnataka, India2h ago
-
AI Engineer INR 3000K-5000KAI Services | Alerting | Application Insights | Audit Logging | AuthenticationCareer development support | Cross-functional collaboration | Flexible ownership of AI platform | Industry certification supportSenior-level Full TimeMumbai, India3h ago
-
Senior-level Full TimePune, Maharashtra, India4h ago
-
Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium) INR 2156K-2800KAPI Testing | Airflow | Azure Kubernetes | Azure Kubernetes Service | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India6h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1860K-4000KAutogen | Cloud Computing | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India7h ago
-
Senior SDET – Performance Engineering INR 2500K-4000KAKS | APM | Azure | C# | CI/CD401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimePune, MH, India8h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India8h ago
-
AI / ML Engineer II / III INR 1800K-3000KAirflow | Anomaly Detection | Apache Spark | Classification | Data EngineeringMid-level Full TimeBengaluru, India8h ago
-
Senior-level Full TimeBangalore, KA, India9h ago
-
Agentic AI Lead INR 2500K-5000KAgent safety | Agent safety evaluation | Agents SDK | Airflow | CI/CDTeam leadershipSenior-level Full TimeChennai, TN, India9h ago
-
Applied AI ML - India Lead INR 3000K-5000KAmazon Web Services | Cloud Computing | Continuous Delivery | Continuous integration | Drift DetectionSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeBangalore, India10h ago
-
AWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeGurugram 8 B, India13h ago
-
AWS | AWS CloudFormation | AWS Lambda | Amazon Bedrock | Amazon EC2Career growth resources | Mentorship | Travel opportunities | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
Senior-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
Mid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
Subcontractor INR 1500K-2500KAWS | Acceptance Testing | Anomaly Detection | Azure | Cloud ComputingStakeholder visibilityMid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
EY - GDS Consulting - AIA - Agentic AI Engineer - Staff INR 2771K-5000KAI Foundry | AI Search | AI Services | API Development | Agent FrameworkSenior-level Full TimeBengaluru, KA, IN, 56004813h ago
-
Data Engineer INR 3000K-4000KAlteryx | DBT | Data Governance | Data Modeling | Data PipelinesEmployee incentive programs | Flexible work hours | Headspace access | Hybrid work | Mental health daysMid-level Full TimeIndia, Bengaluru, Karnataka R13h ago
-
Sr. Infrastructure Engineer (Compute & Storage) INR 3000K-4000KAnsible | Azure | Commvault | Confluence | DellHybrid work | On-call rotationSenior-level Full TimeManyata Tech Park, India13h ago
-
Entry-level Full TimeBangalore, KA, IN13h ago
-
Senior Engineer Data Streaming INR 2000K-3000KAWS Glue | Agile | Amazon Redshift | Apache | Apache KafkaFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India13h ago
-
ACID | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeGurugram 8 B, India16h ago