LatAm - Senior Data Engineer (Databricks)
Colombia
Perficient
Perficient is the leading global digital consultancy transforming how the world’s largest enterprises and biggest brands connect with customers and grow their businesses.
We currently have a career opportunity for a Senior Data Engineer (Databricks) to join our team located in LATAM.
As a Senior Data Engineer you will participate in all aspects of the software development lifecycle which includes estimating, technical design, implementation, documentation, testing, deployment and support of application developed for our clients. As a member working in a team environment you will take direction from solution architects and Leads on development activities.
Perficient is always looking for the best and brightest talent and we need you! We’re a quickly-growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, and become a part of our global community of talented, diverse, and knowledgeable colleagues.
- Work with Data architects to understand current data models, to build pipelines for data ingestion and transformation.
- Design, build, and maintain a framework for pipeline observation and monitoring, focusing on reliability and performance of jobs.
- Ensure data governance, security, and compliance best practices.
- Monitor data pipeline performance and reliability.
- Work in an Agile/Scrum environment, participating in sprint planning, reviews, and continuous improvement initiatives.
- 5+ years of experience in building and maintaining Databricks: Delta Live Tables, Unity Catalog, Data Lakehouse, Medallion Architecture.
- Surface data integration errors to the proper teams focusing on:
- Ensuring timely processing of new data
- Performance of data pipelines
- Integrity and quality of source data
- Hands-on experience building data-lake style infrastructures using streaming data set technologies (particularly with Apache Kafka)
- Development experience utilizing:
- Python: (Pandas/Numpy, Boto3, SimpleSalesforce)
- Databricks (pySpark, pySQL, DLT)
- Apache Spark
- Terraform
- Familiarity with data security, compliance, and governance frameworks (e.g., GDPR, HIPAA).
- Strong problem-solving and analytical skills, with the ability to troubleshoot data pipeline issues effectively.
- Self-starter who thrives in a fast-paced, collaborative environment, working closely with multiple teams.
- Excellent communication and stakeholder management skills, with the ability to translate business requirements into technical solutions.
Perficient full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs including billable bonus opportunities. Encouraging a healthy work/life balance and providing our colleagues great benefits are just part of what makes Perficient a great place to work.
WHO WE ARE
Perficient is a leading global digital consultancy. We imagine, create, engineer, and run digital transformation solutions that help our clients exceed customers’ expectations, outpace competition, and grow their business. With unparalleled strategy, creative, and technology capabilities, our colleagues bring big thinking and innovative ideas, along with a practical approach to help our clients – the world’s largest enterprises and biggest brands succeed.
WHAT WE BELIEVE
At Perficient, we promise to challenge, champion, and celebrate our people. You will experience a unique and collaborative culture that values every voice. Join our team, and you’ll become part of something truly special.
We believe in developing a workforce that is as diverse and inclusive as the clients we work with. We’re committed to actively listening, learning, and acting to further advance our organization, our communities, and our future leaders… and we’re not done yet.
Perficient, Inc. proudly provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws. Perficient, Inc. complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Perficient, Inc. expressly prohibits any form of unlawful employee harassment based on race, color, religion, gender, sexual orientation, national origin, age, genetic information, disability, or covered veterans. Improper interference with the ability of Perficient, Inc. employees to perform their expected job duties is absolutely not tolerated.
Disability Accommodations:
Perficient is committed to providing a barrier-free employment process with reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or accommodation due to a disability, please contact us.
Disclaimer: The above statements are not intended to be a complete statement of job content, rather to act as a guide to the essential functions performed by the employee assigned to this classification. Management retains the discretion to add or change the duties of the position at any time.
Perficient is always looking for the best and brightest talent and we need you! We’re a quickly growing, global digital consulting leader, and we’re transforming the world’s largest enterprises and biggest brands. You’ll work with the latest technologies, expand your skills, experience work-life balance, and become a part of our global community of talented, diverse, and knowledgeable colleagues.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Classification Consulting Databricks Data governance Data pipelines Kafka NumPy Pandas Pipelines PySpark Python Scrum Security Spark Streaming Terraform Testing
Perks/benefits: Career development Competitive pay Flex vacation Salary bonus Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.