Data Engineering Specialist
Bengaluru, IN, 560103
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Build CI and CD pipelines
- Build batch and streaming workloads
- Conduct knowledge transfer
- Demo product developments to stakeholders
- Design data pipelines end to end
- Improve automated testing and deployments
- Ingest data using real time flows
- Line manage junior data engineers
- Optimize ETL and ELT jobs
- Orchestrate data ingestion pipelines
- Perform performance tuning and bottleneck analysis
- Tune Spark jobs and NiFi processors
Perks/Benefits
Skills/Tech-stack
AWS | Ab Initio | Apache NiFi | Apache Spark | BigQuery | Bigtable | CI/CD | Cloudera | ConductIT | Confluence | Dataflow | ELT | ETL | ExpressIT | GCP | GDE | Git | Hadoop | Infrastructure as Code | Jira | Kafka | Kinesis | Kinesis Analytics | PDL | Parallel processing | Performance Tuning | PySpark | SQL | SVN | Scala | Spark SQL | Spark Streaming | Terraform | “as-code”
Education
N/A
Related jobs
-
Data Analytics Professional INR 2500K-4000KAI Algorithms | Automation | Business Intelligence | Data Analysis | Data IntegrityEntry-level Full TimeBengaluru, IN, 5601032h ago
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN3h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India4h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India5h ago
-
Senior Expert INR 2829K-3380KAWS | Algorithms | Azure | Cloud Computing | Data CleansingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India6h ago
-
Software Engineer II INR 2000K-2500KAWS EC2 | AWS RDS | AWS S3 | CI/CD | Data StructuresCross-functional team projects | Learning campus coursesMid-level Full TimeMumbai, India7h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India8h ago
-
Mid-level Full TimePune, IN11h ago
-
Senior Data Migration Engineer INR 2800K-4000KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN11h ago
-
AWS/Airflow Engineer INR 1500K-2400KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsOn-call rotationEntry-level Full TimeBengaluru, KA, IN11h ago
-
Senior-level Full TimePune - Baner, India11h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001611h ago
-
CI/CD | Caching | Clustering | DBT | Data LakesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India11h ago
-
IN-Senior Associate_AI Engineer_Data Analytics_Advisory_Mumbai INR 2000K-4500KA/B | A/B Testing | B testing | CI/CD | CloudFormationSenior-level Full TimeMumbai Goregaon, India11h ago
-
API | Agents | Apache Airflow | Apache Hadoop | Azure DataSenior-level Full TimeKolkata DN 57, India11h ago
-
.NET | .Net Core | API Management | ARM | ASP.NET MVCMid-level Full TimeBengaluru Millenia, India11h ago
-
Mid-level Full TimeGreater Noida, India19h ago
-
Software Test Engineer (Python, Pyspark, SQL) INR 1000K-1500KAPI Testing | Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
Senior Tech Lead INR 2000K-4800K.NET | AKS | ASP.Net Core | Application Insights | Asynchronous programmingSenior-level Full TimeIN-AP-Hyderabad22h ago
-
Datastage Lead INR 2000K-2600KAuto Partitioning | Buffer Tuning | Cause analysis | DSX | Data LineageSenior-level Full TimeIN-AP-Hyderabad22h ago
-
Mid-level Full TimeIndia-Bangalore22h ago
-
Senior AI & Data Engineer INR 2000K-3500KAPI Integration | Apache Spark | Data Ingestion | Data Modeling | Data PartitioningFast-paced environment | Hybrid work | Independent delivery ownershipSenior-level Full TimeIndia22h ago
-
B3.1 Data INR 1500K-3000KArtificial Intelligence | CI/CD | Data Governance | Data Modeling | Data QualityMid-level Full TimeIndia23h ago
-
Senior Data Engineer (Python + Oracle db) INR 2829K-3500KApache Hive | CI/CD | Databricks | Microsoft Azure | Oracle DatabaseEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India23h ago