Spclst , Data Engineering
IND - Telangana - Hyderabad (HITEC City), India
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Automate data flows
- Automate pipeline monitoring
- Build data ingestion platforms
- Build data orchestration pipelines
- Build data transformation platforms
- Create standard reports
- Design data pipelines
- Develop data pipelines
- Extract data from sources
- Implement data orchestration
- Implement logging and monitoring
- Ingest data into cloud data warehouses
- Maintain data pipelines
- Maintain data structures
- Maintain pipeline documentation
- Monitor data integration issues
- Populate data lake
- Populate data warehouse
- Resolve data integration incidents
- Troubleshoot data pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile methodology | Amazon Redshift | Apache Iceberg | Apache Spark | Azure DevOps | CI/CD | Data Modeling | Data integration | Data orchestration | Databricks | Delta Lake | ELT | ETL | GitHub Actions | Jenkins | Logging | Monitoring | PySpark | Python | SQL | Unit Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Related jobs
-
Data Analytics AI Specialist INR 15K-20KClassification | Clustering | Data Visualization | Data cleaning | Machine LearningFast-paced startup environment | Growth opportunities | High ownershipEntry-level Full TimeGurugram, HR, IN6h ago
-
Senior-level Full TimePune, Maharashtra, India9h ago
-
Agentic Data Delivery Lead INR 2000K-4500KAWS | Access Control | Agent systems | Apache Hadoop | Apache SparkSenior-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, Karnataka, India12h ago
-
Snowflake Lead - Manager INR 1500K-2500KAirflow | Anthropic Claude | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Senior Data Developer INR 2000K-2800K21 CFR | 21 CFR Part 11 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeGurugram, HR, IN, 12200214h ago
-
Senior Data Engineer INR 3000K-4000KAWS Lambda | Amazon Web Services | Apache Spark | Aurora PostgreSQL | Batch ProcessingBike to work | Educational assistance | Employee assistance programme | Employee discount | Fitness classesSenior-level Full TimeMumbai, MH, India14h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAPI Development | AWS | Autogen | Azure | Azure OpenAISenior-level Full TimeBangalore, Karnataka, India15h ago
-
Data Governance Engineer - Senior INR 1500K-2500KAgile | Amazon Web Services | Apache Hadoop | Apache Kafka | AzureSenior-level Full TimePune, Maharashtra, India15h ago
-
Senior-level Full TimeBengaluru, India17h ago
-
Senior Software Engineer - Data Platform INR 3000K-4000KAWS | Algorithms | Apache Airflow | Apache Flink | Apache HadoopDisability insurance | Financial wellness support | Health care benefits | Hybrid work | Life insuranceSenior-level Full TimeBengaluru, India20h ago
-
Senior-level Full TimeBangalore, KA, IN20h ago
-
POD Engineers (Int) INR 700K-1000KADLS | AWS | AWS Data | AWS Data Migration | AWS Data Migration ServicesTravel opportunitiesMid-level Full Timetbd, AN, IN20h ago
-
Senior Data Engineer I INR 3000K-4000KAWS Lambda | AWS S3 | AWS Step Functions | CI/CD | Control-MComprehensive benefits package | Development opportunities | Flexible working | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India20h ago
-
Data Engineer - II INR 2000K-3000KAWS S3 | CI/CD | ControlM | Data Modeling | Data QualityDevelopment opportunities | Flexible working hours | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India20h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130120h ago
-
FAAS-Senior Trax, Integrity, Quantum INR 2800K-4200KAPI | Account Management | BAI2 | Bank Statement | Bank Statement IntegrationFlexible work environment | Professional developmentSenior-level Full TimePune, MH, IN, 41101420h ago
-
Python Engineer - AI/ML INR 3500K-5000KAPI Integration | Artificial Intelligence | Chroma | Data Engineering | Data IngestionEntry-level Full TimePLOT NO-1, S.NO. 77, India20h ago
-
A/B | A/B Testing | AWS | Azure | B testingSenior-level Full TimeBengaluru Millenia, India20h ago
-
Lead Data & AI Scientist INR 2500K-5000KAsyncio | Cloud platform | Debugging | Ensemble Methods | ForecastingFlexible working | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India20h ago
-
IN-Manager_Azure Databricks_ Data and Analytics_Advisory_Noida INR 1400K-2000KAWS | Business Intelligence | Data Analysis | Data Quality | Data pipelineFlexible work programs | Mentorship | Wellbeing supportMid-level Full TimeNoida, India20h ago
-
AWS | Azure | Azure DevOps | DevOpsMid-level Full TimeBengaluru Millenia, India20h ago
-
IN-Senior Associate_ Snowflake Senior Data Engineer _Data and Analytics_Advisory_Bangalore INR 1500K-2500KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDSenior-level Full TimeBengaluru Millenia, India20h ago
-
Associate Data Engineer INR 1500K-2000KAWS Redshift | Agile | BigQuery | ETL | GCPFlexible work arrangement | Inclusion and diversity focusMid-level Full TimeBangalore (Ulsoor)IN, India20h ago
-
Application Production Support Engineer - Generative AI Tools- Assistant Vice President INR 1500K-6000KAWS | Azure | Bash | Change Management | Datadog24 7 on call rotation coverageExecutive-level Full TimeTOWER B, EON FREE ZONE II, …20h ago