Data Engineer - PySpark
Bengaluru, Maruthi Onyx - TESCO TSA, India
INR 1500K-2500K (estimate) Entry-level Full Time
Tasks
- Apply data governance and lineage controls
- Build ETL and ELT workflows
- Build data pipelines
- Build orchestration workflows
- Collaborate with data scientists to deploy machine learning models
- Design data lake architectures
- Design data warehouse architectures
- Develop data processing algorithms
- Develop dbt models
- Develop reusable data components
- Implement scalable data storage solutions
- Ingest data into Snowflake
- Write advanced SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Amazon Web Services | Apache Airflow | Apache Spark | CSV | DBT | Data Governance | Data Ingestion | Data Lakes | Data Lineage | Data Warehousing | Dataframes | ELT | ETL | Iceberg | Immuta | JSON | Lake Formation | Machine Learning | NoSQL | PLSQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | SparkSQL | Web Services
Education
N/A
Roles
Related jobs
-
API Development | AWS | Airflow | Azure | Data ModelingCareer growth | Continuous learning | Flexible work environment | Inclusive culture | Professional developmentSenior-level Full TimeIndia3h ago
-
Staff Machine Learning Engineer L5 INR 2520K-3500KAWS | Algorithms | Apache Airflow | Azure | Data StructuresSenior-level Full TimeGurugram, India7h ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN9h ago
-
Data Product Services Analytics Engineer - India INR 2500K-4000KAmazon Redshift | Apache Airflow | BigQuery | Confluence | DBTRemote work flexibility | Training supportMid-level Full TimeIndia R16h ago
-
Mid-level Full TimeBengaluru, KA, India17h ago
-
AI Engineer / AI Developer INR 1800K-3300KAI Agents | Alerting | Amazon SQS | Async Programming | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R18h ago
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN18h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R19h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R19h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India19h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformSenior-level Full TimeIndia - Pune19h ago
-
Entry-level Full TimeCoimbatore, India19h ago
-
Senior-level Full TimeHyderabad, India19h ago
-
Entry-level Full TimeCoimbatore, India20h ago
-
Senior-level Full TimeIN-KA-Bangalore20h ago
-
Senior Engineer - Embedded QA INR 1500K-2094KAgile | CI/CD | Continuous Deployment | Continuous integration | Data Driven TestingSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 411013 R21h ago
-
APIs | Automation | BigQuery | Data Architecture | Data LineageAutonomy | Flexible work environment | Inclusive innovation driven environment | Learning and growth opportunities | Strong ownership cultureSenior-level Full TimeIndia21h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
AI Engineer - AI, Data & Platforms INR 3000K-4200KAgentic Workflows | Apache Airflow | Apache Spark | DBT | Dagster4 day in office 1 day flexible work arrangement | Flexible work arrangementSenior-level Full TimeGurugram22h ago
-
Staff Software Engineer, Play Games Discovery INR 2500K-4500KData Pipelines | Data Processing | Data Structures | Data Structures and Algorithms | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
DevOps Track Sr.Engineer INR 2229K-4000KAPI Gateway | APM | AWS CloudWatch | AWS Systems Manager | AWS systemsSenior-level Full TimeIndia22h ago
-
Database Track Sr.Engineer INR 2000K-3000KData Architecture | Database Schemas | Database performance | Database performance tuning | Disaster RecoverySenior-level Full TimeIndia22h ago
-
Big Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data IngestionSenior-level Full TimeIndia22h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2000K-3500KA/B | A/B Testing | B testing | Clustering | Data WarehousingSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Big Data Lead INR 1500K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia23h ago