Data Engineer
Chennai, Tamil Nadu, India - Remote
Experience.com
Turn Customer & Employee Feedback into Actionable Insights with Experience.com. Capture real-time feedback, manage reviews, elevate brand reputation, and unlock valuable insights. Find and refer the best professionals.Come Join Us
Experience.com - We make every experience matter more
Position: Data Engineer
Experience: 4+ Years
Job Location: Remote
Employment Type: Full Time
Responsibilities
- Design, build, and maintain scalable and robust ETL/ELT pipelines using PySpark and SQL.
- Work on data extraction, transformation, and loading processes from multiple sources into data warehouses such as BigQuery.
- Leverage GCP data analytics tools (BigQuery, DataProc, Cloud Functions, etc.) to process and analyze data.
- Optimize data workflows for benchmarking, performance, and tuning to ensure efficiency and reliability.
- Collaborate with engineering and analytics teams to develop data integration solutions that meet business needs.
- Ensure the accuracy and quality of data by implementing strong in-memory applications and database designs.
- Implement monitoring and alerting for pipelines and workflows to ensure data consistency and issue resolution.
Skills and Qualifications
Must-Have:
- 4+ years of experience with PySpark and SQL for building scalable ETL pipelines.
- Strong proficiency in Python programming.
- Knowledge of GCP Data Analytics ecosystem (BigQuery, PySpark, SQL, etc.).
- Experience with Airflow/Composer for workflow orchestration.
- Experience with in-memory applications, database design, and data integration.
- Strong analytical thinking and problem-solving abilities.
Preferred:
- Familiarity with data pipeline mechanisms such as Kafka or Pub/Sub, Cloud Functions
- Hands-on experience with Elasticsearch, and MongoDB.
About Us
We believe that experience is everything. Experience.com has built the most impactful Experience Management Platform (XMP) available anywhere, with features to drive operational and behavioral change, in real-time, during the moments that matter. XMP delivers impactful business outcomes including increased customer satisfaction, brand loyalty, online reputation and visibility, as well as improved employee engagement, and compliance - making every experience matter more.
Founded in 2015 and originally founded as SocialSurvey, Experience.com is headquartered in San Ramon, Calif. and backed by SavantGrowth (fka Kennet Partners), Silicon Valley Data Capital, Tri-Valley Ventures, and Wilson Sonsini Goodrich & Rosati.
Indian Registered name: Buyers Road India Private Limited
URL: www.experience.com
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow BigQuery Data Analytics Dataproc Elasticsearch ELT Engineering ETL GCP Kafka MongoDB Pipelines PySpark Python SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.