Data Engineer - PySpark
Pune, Gera Commerzone SEZ, India
INR 1500K-2500K (estimate) Entry-level Full Time
Tasks
- Build ELT pipelines using dbt
- Build and maintain data pipelines
- Collaborate with data scientists to deploy machine learning models
- Design and implement Data Lakes and Data Warehouses
- Develop data transformation and processing algorithms
- Develop reusable data components
- Ingest data into Snowflake
- Use data governance or lineage tools
- Write advanced SQL and PL SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Apache Airflow | CSV | DBT | Dataframes | ELT | Iceberg | Immuta | JSON | Lake Formation | NoSQL | PL/SQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | SparkSQL
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia6h ago
-
Agile | Alerting | Automation | CI/CD | ClusteringAgile environment | Professional growthSenior-level Full TimeIndia7h ago
-
AI Governance | AWS | Agentic Workflows | CI/CD | Cloud NativeSenior-level Full TimeAPAC - India - Bengaluru - …9h ago
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R10h ago
-
Senior-level Full TimeBangalore North, India17h ago
-
Senior-level Full TimeBangalore North, India17h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India17h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …19h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …20h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R21h ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India21h ago
-
Senior-level Full TimeGurugram, Haryana, India22h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad23h ago
-
FDH Support Leader INR 2500K-3500KAlerting | CI/CD | Data Contracts | Data Lineage | Data ObservabilitySenior-level Full TimePune, Maharashtra, IND, 41101323h ago
-
Senior Data Engineer- Managed services INR 3000K-4000KAzure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure Data | Azure Data FactoryRemote work opportunitySenior-level Full TimePune, MH, India23h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Autonomy | Fully remote | Remote work flexibilitySenior-level Contract Full TimeIndia R1d ago
-
Senior Analyst, Analytics Engineer INR 2771K-4000KApplication Monitoring | DBT | Data Compliance | Data Governance | Data ModelingRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN1d ago
-
AI Agent framework | AWS | Agent Framework | Alerting | AzureCollaborative environment | Interview accommodations | Professional growthSenior-level Full TimeIndia1d ago
-
AWS | Azure | Django | Embeddings | FastAPIContract or consulting engagement | Part-time engagement | Remote work within India | Technical ownership and autonomyMid-level Full TimeIndia R1d ago
-
APIs | AWS | Azure | CI/CD | ContainerizationDental insurance | Equity | Flexible Health Support | Flexible time off | Health insuranceSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India1d ago