Senior Applications Developer : Bigdata - Python, Pyspark
TOWER B, EON FREE ZONE II, India
INR 2800K-4000K (estimate) Senior-level Full Time
Tasks
- Analyze requirements
- Collaborate with cross-functional teams
- Conduct code reviews
- Design data pipelines
- Develop ETL processes
- Develop KYC data solutions
- Develop data applications
- Enforce coding standards
- Ensure data quality
- Implement scalable solutions
- Integrate AI driven data extraction
- Monitor data pipeline performance
- Optimize database performance
- Process transform manage large datasets
- Propose technical solutions
- Provide technical guidance and mentorship
- Resolve integration issues
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
ADF | ADLS | AWS | AWS Step Functions | Anomaly Detection | Apache Airflow | Apache Hadoop | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | CI/CD | Cloud platform | Data Factory | Databricks | Dataframes | Django | Docker | EMR | ETL | FastAPI | Flask | GCP | Git | GitLab CI | Google Cloud | Google Cloud Platform | Hive | Integration Testing | Jenkins | Kafka | Kubernetes | Machine Learning | MongoDB | MySQL | ORC | Oracle | Parquet | Performance Testing | PostgreSQL | PySpark | PyTorch | Pytest | Python | REST API | S3 | SQL | SQL Server | Spark SQL | Spark Streaming | Step Functions | TensorFlow | Unit Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Power BI Developer INR 1628K-2500KAccess Control | DAX | Data Governance | Data Modeling | Data QualitySenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Association | Classification | Data Modeling | Data Warehousing | ETLSenior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Gen AI INR 300K-420KGenerative AI | JSON | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Associate Software Engineer - Spark/Scala INR 1500K-2000KApache Spark | CI/CD | Databricks | DevSecOps | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India10h ago
-
Software Engineer (Python, Pyspark, SQL) INR 1200K-2100KAWS | Azure | CI/CD | GCP | GitEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India10h ago
-
Principal Data Engineer INR 2520K-3380KApp Services | Azure | Azure App | Azure App Services | Azure CognitiveSenior-level Full TimeBengaluru Luxor North Tower, India16h ago
-
API Design | AWS | Agentic AI | C++ | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Senior-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Associate Engineer INR 1500K-2500KAKS | AWS | App Services | Azure | Azure AppHybrid work model | On-call rotation | Professional office environmentMid-level Full TimeIND-Pune-Smartworks, India16h ago
-
Gen AI Developer - Assistant Vice President INR 2400K-4000KAPI Development | Containerization | Data Privacy | Deep learning | DockerExecutive-level Full TimeIT BUILDING, RAMANUJAN IT SEZ,, India16h ago
-
Senior Conversational AI Engineer (Speech & NLU) INR 2000K-3500KA/B | A/B Testing | Acoustic Modeling | B testing | Conversational AICareer development training | Flexible work arrangements | Paid time off | Pension plan | Private health insuranceSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Entry-level Full TimeBangalore, KA, IN16h ago
-
Senior Data Engineer INR 2600K-3380KAWS Data | AWS Data Services | Apache Iceberg | Data Governance | Data LakehouseSenior-level Full TimeBangalore, KA, IN16h ago
-
Senior AI / Agentic AI Engineer INR 2520K-3500KAWS Bedrock | Agent systems | Generative AI | Knowledge graphs | LangchainSenior-level Full TimeBangalore, KA, IN16h ago
-
Senior Software Engineer INR 2800K-4000KAI | Access Control | Airflow | Artificial Intelligence | AstronomerSenior-level Full TimePune, India R16h ago
-
AI Engineer INR 2000K-3500KAPI Development | CI/CD | Cloud Native | Cloud-native development | ContainersHealth and wellbeing support | Professional developmentMid-level Full TimeFIL Bengaluru Office, India16h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KARM | Board Bring-up | Bootloader | Bring-up | C#Car lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …16h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KBoard Bringup | Bootloader | C# | C++ | Change ControlCar lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …16h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KARM | Board Bring-up | Bootloader | Bring-up | C#Car lease programme | Contingency leave 12 days | Employee scholar programme | Fuel and maintenance allowance | Group health insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …16h ago
-
Principal Engineer - (Embedded Platform Software, RTOS) INR 1753K-2372KARM | ARM architecture | Architecture Design | Avionics | Board Bring-upCar lease programme | Contingency leave | Employee scholar programme | Fuel and maintenance driver wages | Group health insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …16h ago
-
Software Engineering SMTS- Tableau INR 2775K-4500KAWS | Agile | Azure | C# | Cloud deploymentAdoption Assistance | Fertility benefits | On-demand training | Parental leave | Volunteer opportunitiesSenior-level Full TimeIndia - Hyderabad16h ago
-
Digital R&D Physical AI Engineering Expert INR 3000K-4000KActive Learning | Bayesian optimization | C++ | Digital Twins | Isaac LabSenior-level Full TimeHyderabad, India16h ago
-
Senior Data Engineer INR 1500K-2500KAPIs | Automation | Azure | Cloud Computing | Data GovernanceHybrid work | Travel 10 percentSenior-level Full TimeHaryana, Gurugram International Techpark, Block III …16h ago