Senior Data Engineer- Azure
New York, NY, United States
Full Time Senior-level / Expert USD 103K - 150K
Publicis Groupe
Company Description
Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.
Job Description
Publicis Sapient is looking for a Senior Associate Data Engineer to be part of our team of top-notch technologists. You will lead and deliver technical solutions for large-scale digital transformation projects. Working with the latest data technologies in the industry, you will be instrumental in helping our clients evolve for a more digital future.
Your Impact:
- Combine your technical expertise and problem-solving passion to work closely with clients, turning complex ideas into end-to-end solutions that transform our client's business
- Translate client's requirements to system design and develop a solution that delivers business value
- Lead, designed, develop, and deliver large-scale data systems, data processing, and data transformation projects
- Automate data platform operations and manage the post-production system and processes
- Conduct technical feasibility assessments and provide project estimates for the design and development of the solution
- Mentor, help and grow junior team members
Your Technical Skills & Experience:
- Demonstrable experience in data platforms involving the implementation of end-to-end data pipelines
- Hands-on experience in Azure cloud platform.
- Implementation experience with column-oriented database technologies (i.e., Big Query, Redshift, Vertica), NoSQL database technologies (i.e., DynamoDB, BigTable, Cosmos DB, etc.) and traditional database systems (i.e., SQL Server, Oracle, MySQL)
- Experience in implementing data pipelines for both streaming and batch integrations using tools/frameworks like Azure Data Factory, Glue ETL, Lambda, Spark, Spark Streaming, etc.
- Knowledge of streaming technologies preferably Kafka and spark streaming to ingest high volume, high velocity datasets
- Hands-on experience in using Databricks or spark notebooks (preferred language scala) to perform ETL and design workflow orchestrations.
- Ability to handle module or track level responsibilities and contributing to tasks “hands-on”
- Experience in data modeling, warehouse design and fact/dimension implementations
- Experience working with code repositories and continuous integration
- Data modeling, querying, and optimization for relational, NoSQL, timeseries, and graph databases and data warehouses and data lakes
- Data processing programming using SQL, DBT, Python, and similar tools
- Logical programming in Python, Spark, PySpark, Java, Javascript, and/or Scala
- Data ingest, validation, and enrichment pipeline design and implementation
- Cloud-native data platform design with a focus on streaming and event-driven architectures
- Test programming using automated testing frameworks, data validation and quality frameworks, and data lineage frameworks
- Metadata definition and management via data catalogs, service catalogs, and stewardship tools such as OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog, and similar
- Code review and mentorship
- Bachelor’s degree in Computer Science, Engineering or related field.
Set Yourself Apart With:
- Developer certifications for any of the cloud services like AWS, Google Cloud or Azure
- Understanding of development and project methodologies
- Willingness to travel
Additional Information
Pay Range:$103,000 -$150,000
The range shown represents a grouping of relevant ranges currently in use at Publicis Sapient. Actual range for this position may differ, depending on location and specific skillset required for the work itself.
Benefits of Working Here:
- Flexible vacation policy; time is not limited, allocated, or accrued
- 16 paid holidays throughout the year
- Generous parental leave and new parent transition program
- Tuition reimbursement
- Corporate gift matching program
As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at hiring@publicissapient.com or you may call us at +1-617-621-0200.
Tags: Agile Architecture AWS AWS Glue Azure BigQuery Bigtable Computer Science Consulting Cosmos DB CX Databricks Data pipelines dbt DynamoDB Engineering ETL GCP Google Cloud Java JavaScript Kafka Lambda MySQL NoSQL Oracle Pipelines PySpark Python Redshift Scala Spark SQL Streaming Testing
Perks/benefits: Career development Flex hours Flex vacation Parental leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.