Engineer - PySpark/SQL
Pune, Gera Commerzone SEZ, India
INR 1500K-2500K (estimate) Entry-level Full Time
Tasks
- Build data lake systems
- Build data pipelines
- Build reusable components
- Collaborate with stakeholders to gather requirements
- Deploy machine learning models with data scientists
- Design data warehouse solutions
- Develop ELT pipelines with DBT
- Develop data transformation logic
- Develop processing and analysis algorithms
- Ensure data governance and lineage
- Implement scalable data storage solutions
- Ingest data into Snowflake
- Orchestrate ETL workflows
- Translate user stories into ETL components
- Write PL SQL programs
- Write advanced SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Cloud | AWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | CSV | DBT | Data Governance | Data Ingestion | Data Lineage | Data Marts | Data Transformation | Data Warehousing | DataFrame | ELT | Iceberg | Immutta | JSON | Lake Formation | NoSQL | PL/SQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | SparkSQL
Education
N/A
Roles
Related jobs
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune6h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia7h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India8h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India8h ago
-
Mid-level Full TimePune, Maharashtra, India R9h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India9h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India10h ago
-
Lead Software Engineer - AI-Augmented Full Stack Development INR 3000K-5000KAI Assisted Development | API Design | AWS | Agile methodologies | AngularSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India12h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003213h ago
-
Mid-level Full TimeBengaluru, Karnataka, India13h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India14h ago
-
Software Engineer - Data Engineering INR 1500K-2541KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite 5 days per week | Relocation assistance | Visa sponsorshipMid-level Full TimeChennai, Tamil Nadu, India18h ago
-
Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India18h ago
-
Lead Software Engineer- Data Engineer INR 2000K-3000KAWS | AWS CloudFormation | Agile | Azure DevOps | CI/CDOnsite work five days per week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Senior-level Full TimeBangalore, KA, IN18h ago
-
Lead Software Engineer (AWS, Snowflake & ML Backend) INR 3000K-4500KAWS | AWS Lambda | AWS Step Functions | Access Control | Amazon ECSOnsite work 5 days per week | Relocation supportSenior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Senior Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work 5 days per week | Relocation assistanceSenior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Senior Machine Learning Engineer INR 3000K-5000KBacktesting | Data Validation | Feature Engineering | Model Monitoring | Probabilistic ModelingSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Senior Data Engineer INR 1500K-3000KCloud Data | Cloud Data Infrastructure | Data Deduplication | Data Infrastructure | Data ModelingSenior-level Full TimeMumbai, Maharashtra, India18h ago