Senior Data Engineer
New Jersey, Parsippany-Troy Hills, United States of America
StatusNeo
Striving for excellence is in our DNA. At the core of our identity, the pursuit of excellence defines every action we take. We aren’t just specialists; we are pioneers in Platform and Product Engineering. with a sharp focus on Cloud Native D3 (Digital, Data, DevSecOps). We empower global leaders to envision, craft, and implement software and digital solutions that revolutionize industries.About StatusNeo:At StatusNeo, we are committed to redefining the way businesses operate. As a leader in digital transformation, we leverage cutting-edge technologies and innovative strategies to empower organizations around the globe. Our partnerships with industry giants and our commitment to continuous learning and improvement provide an unparalleled platform for professional growth. Embrace a career at StatusNeo, where we value diversity, and inclusivity and foster a hybrid work culture. Key Responsibilities:
- Design and implement scalable ETL workflows using PySpark and Python.
- Develop and optimize complex SQL queries for data transformation and reporting.
- Work extensively with AWS Cloud services like S3, Glue, Redshift, and Lambda to manage data processes.
- Utilize Oracle Cloud Infrastructure (OCI) services to integrate and manage cross-cloud data operations.
- Collaborate on hybrid cloud solutions leveraging AWS and OCI for seamless data processing.
- Ensure performance optimization, scalability, and reliability of data pipelines.
- Maintain data quality, security, and governance standards across all platforms.
- Lead initiatives to troubleshoot, debug, and optimize large-scale data solutions.
- Advanced expertise in designing and implementing ETL pipelines using PySpark
- Proficient in scripting and developing data workflows with Python
- Expert in writing and optimizing complex queries using SQL
- In-depth knowledge of AWS Cloud services, including S3, Redshift, Glue, and Lambda
- Hands-on experience with Oracle Cloud Infrastructure (OCI) services and integrations
- Experience with big data frameworks and data processing pipelines
- Familiarity with data governance, including security, quality, and compliance standards
- Exposure to CI/CD pipelines and automated deployments (preferred)
- Ability to adjust to new conditions and effectively handle change.
- Proficient in identifying problems and brainstorming potential solutions.
- Willingness to work collaboratively with colleagues to achieve common goals.
- Capacity to manage time efficiently and prioritize tasks effectively.
- Ability to think outside the box and bring forward innovative ideas.
- Willing to travel as needed
- Engage in both national and international business trips to expand your professional network and gain diverse industry insights.
- Thrive in an environment that prioritizes knowledge sharing and ongoing professional development through structured training programs.
- Work in a modern and vibrant setting that fosters creativity and innovation.
- Contribute to the industry by writing books and participating in leading conferences, enhancing both personal and professional growth.
- Explore various international assignments that provide a platform for significant career advancement and global exposure.
- Benefit from the chance to relocate, offering personal and professional development in new geographical and cultural landscapes.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: AWS Big Data CI/CD D3 Data governance DataOps Data pipelines Data quality Engineering ETL Lambda Oracle Pipelines PySpark Python Redshift Security SQL
Perks/benefits: Career development Conferences
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Staff Machine Learning Engineer jobsPrincipal Data Engineer jobsData Scientist II jobsStaff Data Scientist jobsBI Developer jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsBusiness Data Analyst jobsLead Data Analyst jobsSenior AI Engineer jobsData Engineer III jobsData Specialist jobsData Science Intern jobsSr. Data Scientist jobsData Analyst Intern jobsSoftware Engineer II jobsSoftware Engineer, Machine Learning jobsData Analyst II jobsAzure Data Engineer jobsPrincipal Software Engineer jobsJunior Data Engineer jobsBI Analyst jobsSenior Data Scientist, Performance Marketing jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsJavaScript jobsHadoop jobsBanking jobsComputer Vision jobsGoogle Cloud jobsKafka jobsPhysics jobsData Warehousing jobsRDBMS jobsNoSQL jobsR&D jobsAirflow jobsMLOps jobsKPIs jobsScala jobsClassification jobsOracle jobsData warehouse jobsStreaming jobsGitHub jobsPostgreSQL jobs
Scikit-learn jobsCX jobsSAS jobsScrum jobsTerraform jobsData Mining jobsPySpark jobsPandas jobsDistributed Systems jobsRobotics jobsBigQuery jobsIndustrial jobsJira jobsLooker jobsUnstructured data jobsE-commerce jobsJenkins jobsRedshift jobsdbt jobsReact jobsMicroservices jobsData strategy jobsPharma jobsMySQL jobsNumPy jobs