Data Engineering Specialist
Bengaluru, IN, 560103
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Build CI and CD pipelines
- Build batch and streaming workloads
- Conduct knowledge transfer
- Demo product developments to stakeholders
- Design data pipelines end to end
- Improve automated testing and deployments
- Ingest data using real time flows
- Line manage junior data engineers
- Optimize ETL and ELT jobs
- Orchestrate data ingestion pipelines
- Perform performance tuning and bottleneck analysis
- Tune Spark jobs and NiFi processors
Perks/Benefits
Skills/Tech-stack
AWS | Ab Initio | Apache NiFi | Apache Spark | BigQuery | Bigtable | CI/CD | Cloudera | ConductIT | Confluence | Dataflow | ELT | ETL | ExpressIT | GCP | GDE | Git | Hadoop | Infrastructure as Code | Jira | Kafka | Kinesis | Kinesis Analytics | PDL | Parallel processing | Performance Tuning | PySpark | SQL | SVN | Scala | Spark SQL | Spark Streaming | Terraform | “as-code”
Education
N/A
Related jobs
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601033h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN4h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India4h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India6h ago
-
Senior Expert INR 2829K-3380KAWS | Algorithms | Azure | Cloud Computing | Data CleansingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India7h ago
-
Software Engineer II INR 2000K-2500KAWS EC2 | AWS RDS | AWS S3 | CI/CD | Data StructuresCross-functional team projects | Learning campus coursesMid-level Full TimeMumbai, India8h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India8h ago
-
Mid-level Full TimePune, IN12h ago
-
Senior Data Migration Engineer INR 2800K-4000KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN12h ago
-
AWS/Airflow Engineer INR 1500K-2400KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsOn-call rotationEntry-level Full TimeBengaluru, KA, IN12h ago
-
Senior-level Full TimePune - Baner, India12h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001612h ago
-
CI/CD | Caching | Clustering | DBT | Data LakesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India12h ago
-
IN-Senior Associate_AI Engineer_Data Analytics_Advisory_Mumbai INR 2000K-4500KA/B | A/B Testing | B testing | CI/CD | CloudFormationSenior-level Full TimeMumbai Goregaon, India12h ago
-
API | Agents | Apache Airflow | Apache Hadoop | Azure DataSenior-level Full TimeKolkata DN 57, India12h ago
-
.NET | .Net Core | API Management | ARM | ASP.NET MVCMid-level Full TimeBengaluru Millenia, India12h ago
-
Full Stack Data Engineer - Methods & Tools INR 1500K-3000KAWS | Angular | Azure | CSS | DockerEqual opportunity employment | Flexible working arrangementsMid-level Full TimeBangalore (Airbus), India12h ago
-
Mid-level Full TimeGreater Noida, India20h ago
-
Software Test Engineer (Python, Pyspark, SQL) INR 1000K-1500KAPI Testing | Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Senior Tech Lead INR 2000K-4800K.NET | AKS | ASP.Net Core | Application Insights | Asynchronous programmingSenior-level Full TimeIN-AP-Hyderabad23h ago
-
Datastage Lead INR 2000K-2600KAuto Partitioning | Buffer Tuning | Cause analysis | DSX | Data LineageSenior-level Full TimeIN-AP-Hyderabad23h ago
-
Mid-level Full TimeIndia-Bangalore23h ago
-
Senior AI & Data Engineer INR 2000K-3500KAPI Integration | Apache Spark | Data Ingestion | Data Modeling | Data PartitioningFast-paced environment | Hybrid work | Independent delivery ownershipSenior-level Full TimeIndia23h ago
-
B3.1 Data INR 1500K-3000KArtificial Intelligence | CI/CD | Data Governance | Data Modeling | Data QualityMid-level Full TimeIndia23h ago