Data Engineer
Tasks
- Aggregate and combine data from multiple sources
- Analyze data pipes and systems to identify improvements
- Assist with proofs of concept
- Build automated processes to measure data quality failures and errors
- Collaborate on dimensional data modeling with Kimball practices
- Design data quality controls and thresholds
- Develop data quality measurement and reporting processes
- Develop support and remediation processes
- Profile data sources and identify ETL quality issues
- Tune CI CD framework using Azure DevOps
Perks/Benefits
- N/A
Skills/Tech-stack
Analysis Services | Azure | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Catalog | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | DAX | Data Catalog | Data Factory | Data Lake Storage | Data Quality | ETL | Microsoft SQL | Microsoft SQL Server | Power BI | Powershell | Python | SQL Server | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium) INR 2156K-2800KAPI Testing | Airflow | Azure Kubernetes | Azure Kubernetes Service | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India6h ago
-
Senior SDET – Performance Engineering INR 2500K-4000KAKS | APM | Azure | C# | CI/CD401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimePune, MH, India7h ago
-
AI / ML Engineer II / III INR 1800K-3000KAirflow | Anomaly Detection | Apache Spark | Classification | Data EngineeringMid-level Full TimeBengaluru, India8h ago
-
Senior-level Full TimeBangalore, KA, India9h ago
-
Agentic AI Lead INR 2500K-5000KAgent safety | Agent safety evaluation | Agents SDK | Airflow | CI/CDTeam leadershipSenior-level Full TimeChennai, TN, India9h ago
-
Senior-level Full TimeBangalore, India10h ago
-
AWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeGurugram 8 B, India13h ago
-
AWS | AWS CloudFormation | AWS Lambda | Amazon Bedrock | Amazon EC2Career growth resources | Mentorship | Travel opportunities | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
Senior-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
Mid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
Subcontractor INR 1500K-2500KAWS | Acceptance Testing | Anomaly Detection | Azure | Cloud ComputingStakeholder visibilityMid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …13h ago
-
EY - GDS Consulting - AIA - Agentic AI Engineer - Staff INR 2771K-5000KAI Foundry | AI Search | AI Services | API Development | Agent FrameworkSenior-level Full TimeBengaluru, KA, IN, 56004813h ago
-
Data Engineer INR 3000K-4000KAlteryx | DBT | Data Governance | Data Modeling | Data PipelinesEmployee incentive programs | Flexible work hours | Headspace access | Hybrid work | Mental health daysMid-level Full TimeIndia, Bengaluru, Karnataka R13h ago
-
Sr. Infrastructure Engineer (Compute & Storage) INR 3000K-4000KAnsible | Azure | Commvault | Confluence | DellHybrid work | On-call rotationSenior-level Full TimeManyata Tech Park, India13h ago
-
Entry-level Full TimeBangalore, KA, IN13h ago
-
Senior Engineer Data Streaming INR 2000K-3000KAWS Glue | Agile | Amazon Redshift | Apache | Apache KafkaFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India13h ago
-
ACID | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeGurugram 8 B, India16h ago
-
Principal Software Engineer INR 3242K-4500KAWS | Azure | Azure DevOps | CI/CD | Cloud platformEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India18h ago
-
Mid-level Full TimePune, India19h ago
-
AWS Data Engineer with BI Connector To snowflake migration Exp(6+ Yrs of Exp & Immediate Joiner looking for) INR 1500K-2500KAWS | AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatchImmediate joiningMid-level Full TimeIndia20h ago
-
Software Engineer Data Analytics INR 1850K-2500KAPI Development | API Integration | Agile | AppSheet | Apps ScriptFlexible work modelMid-level Full TimeHyderabad, India21h ago
-
Senior Data Engineer INR 3242K-4580KAI tools | AWS | Airflow | Batch Architecture | DBTRemote work opportunitiesSenior-level Full TimeIndia R22h ago
-
Data Engineer II INR 2040K-3380KAWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowComplimentary games | Family leave | Healthcare coverage | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India23h ago
-
Data Engineer II INR 2040K-3380KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamComplimentary games | Family leave | Healthcare coverage | Hybrid work model | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India23h ago
-
Mid-level Full TimeGurugram23h ago