T

Data Engineer

Tcs Uk
7 days ago
Contract
On-site
London, United Kingdom
Β£400 - Β£450 GBP hourly
Data Engineer

The Role:

Primarily looking for Palantir Foundry Data Engineer / Palantir Developer with strong expertise in data engineering, Python, and distributed data processing.

Your responsibilities:

  • Build and maintain Palantir Foundry ontologies, pipelines, and applications.

  • Design and develop scalable ETL/data engineering solutions using Python and PySpark.

  • Integrate and transform data from multiple enterprise data sources.

  • Optimize Spark-based data processing and workflow performance.

  • Collaborate with business stakeholders to deliver analytics and AI-ready data products.

Essential skills/knowledge/experience:

  • Palantir Platform Expertise

o Working with Foundry Ontology, pipelines, and modular applications.

o Implementing End to End data Β Solutions inΒ  Palantir Β sourcing data from

  • Programming & Scripting (Python and PySpark)

o Data Processing & Automation: Ability to clean, transform, and process large datasets efficiently.

o Integration with Palantir Foundry: Build custom Python functions and libraries to extend Foundry’s capabilities.

o Pipeline Development: Write modular, reusable code for ETL workflows and data transformations.

o Performance Optimization: Use Python libraries like Pandas, NumPy, and PySpark for scalable data operations.

o Familiarity with SQL for querying and data modeling. – Good to have

  • Data Engineering Fundamentals

o Building ETL pipelines for ingestion and transformation.

o Designing data models and optimizing workflows.

o Handling structured and unstructured data.

  • Big Data & Distributed Systems

o Experience with Spark (PySpark) for scalable data processing.

o Understanding of parallel computing and performance tuning.