aijobs.net

Pyspark Developer

Pune City, India

Applications have closed
Company logo

DATAECONOMY

Enabling Businesses to Monetize Data at Data Speeds with cutting edge Technology Services and Solutions. Big Data Management, Cloud enablement, Data Science, etc..

View all jobs at DATAECONOMY

Find more jobs like this Jobs in India

Join DataEconomy and be part of a dynamic team driving data-driven solutions. We're seeking highly skilled PySpark developers with 4-6 years of experience to join our team in Hyderabad or Pune.

Responsibilities:

  • Design and implement robust metadata-driven data ingestion pipelines using PySpark.
  • Collaborate with technical teams to develop innovative data solutions.
  • Work closely with business stakeholders to understand and translate requirements into technical specifications.
  • Conduct unit testing, system testing, and support during UAT.
  • Demonstrate strong analytical and problem-solving skills, as well as a commitment to excellence in software development.
  • Experience in the financial or banking domain is a plus.





Requirements

Requirements

  • 4-8 years of experience in IT, with a minimum of 4 years of hands-on experience in Python and PySpark.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Proficiency in Linux and Java is a plus.
  • Experience with code versioning tools like Git, AWS CodeCommit, and CI/CD pipelines (e.g., AWS CodePipeline).
  • Proven ability to build metadata-driven frameworks for data ingestion.
  • Familiarity with various designs and architectural patterns.


    • Benefits


    Benefits

  • Opportunities for professional growth and development.
  • Be part of a dynamic and collaborative team.


    • Find more jobs like this Jobs in India

    * Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

    Job stats:  0  0  0
    Category: Engineering Jobs

    Tags: AWS Banking CI/CD Data Warehousing ETL Git Java Linux Pipelines PySpark Python Testing

    Perks/benefits: Career development

    Region: Asia/Pacific
    Country: India

    More jobs like this

    « Back to job search To the top ↑

    Explore more career opportunities

    Find even more open roles below ordered by popularity of job title or skills/products/technologies used.

    Data Scientist II jobsData Engineer II jobsSr. Data Engineer jobsBusiness Intelligence Analyst jobsPrincipal Data Engineer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsData Science Manager jobsData Manager jobsData Science Intern jobsPrincipal Software Engineer jobsJunior Data Analyst jobsBusiness Data Analyst jobsData Analyst Intern jobsSoftware Engineer II jobsData Specialist jobsDevOps Engineer jobsSr. Data Scientist jobsLead Data Analyst jobsResearch Scientist jobsStaff Software Engineer jobsData Engineer III jobsAI/ML Engineer jobsSenior Backend Engineer jobsBI Analyst jobs
    NLP jobsAirflow jobsOpen Source jobsEconomics jobsKafka jobsLinux jobsMLOps jobsNoSQL jobsJavaScript jobsTerraform jobsComputer Vision jobsKPIs jobsGoogle Cloud jobsData Warehousing jobsPhysics jobsRDBMS jobsPostgreSQL jobsBanking jobsScikit-learn jobsScala jobsHadoop jobsGitHub jobsData warehouse jobsPandas jobsStreaming jobs
    R&D jobsBigQuery jobsOracle jobsClassification jobsCX jobsdbt jobsPySpark jobsDistributed Systems jobsLooker jobsReact jobsScrum jobsRAG jobsMicroservices jobsRobotics jobsJira jobsRedshift jobsSAS jobsIndustrial jobsGPT jobsPrompt engineering jobsMySQL jobsELT jobsNumPy jobsData Mining jobsData strategy jobs