Sr PySpark developer - Jersey City
United States
Full Time Senior-level / Expert USD 52K - 184K
Photon
Photon, a global leader in digital transformation services and IT consulting, works with 40% of the Fortune 100 companies as their digital agency of choice.Requirements and Qualifications:
- 8+ years of relevant experience in the Data Engineering, ApacheSpark
- Strong proficiency in PySpark and Apache Spark.
- Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).
- Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).
- Expertise in cloud platforms (AWS, Azure, or GCP).
- Proficiency in Python programming and data manipulation.
- Knowledge of ETL tools, data lakes, and data warehouses.
- Experience in CI/CD, containerization (Docker, Kubernetes) is a plus.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork skills.
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Compensation, Benefits and Duration
Minimum Compensation: USD 52,000
Maximum Compensation: USD 184,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Tags: AWS Azure Big Data Cassandra CI/CD Docker Engineering ETL GCP Hadoop HBase Kafka Kubernetes NoSQL PySpark Python Spark SQL
Perks/benefits: 401(k) matching Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.