secondsky/sap-datasphere

SAP Datasphere Skill

Related Skills

• sap-dependency-security: Use for secure dependency policy, lockfile hygiene, and exact MCP server pins when managing large connector or integration projects with package-managed tooling

Table of Contents

• Overview
• Quick Reference
  • Core Components
  • Object Types
• Data Builder
  • Graphical Views
  • SQL Views
  • Tables
  • Flows
  • Task Chains
• Business Builder
• Analytic Models
• Connections
• Space Management
• Data Access Control
• Monitoring
• CLI Reference
• Data Products & Marketplace
• Catalog & Governance
• Content Transport
• Common Issues
• Bundled Resources
• Documentation Links

Overview

SAP Datasphere is SAP's cloud-native data warehouse solution on SAP Business Technology Platform (BTP). It serves as the data foundation within SAP Business Data Cloud (BDC), SAP's unified data and analytics platform that also includes SAP Analytics Cloud, SAP HANA Cloud, SAP Databricks, and curated data products. See references/business-data-cloud.md for the BDC architecture and how Datasphere fits within it.

This skill provides comprehensive guidance for data acquisition, preparation, modeling, administration, and integration.

When to Use This Skill

Use this skill when:

• Creating data warehouses on SAP BTP
• Building analytic models for SAP Analytics Cloud
• Setting up data flows, replication flows, or transformation flows
• Configuring connections to SAP or third-party systems
• Managing spaces, users, and access controls
• Implementing real-time data replication
• Monitoring data integration tasks
• Inspecting authenticated Datasphere browser UI state in Microsoft Edge when MCP, CLI, logs, or exported artifacts cannot observe the needed state

For Datasphere browser triage, use the shared sap-browser-automation skill for manual in-app authentication, consent-gated authenticated Edge profile copying, fresh loopback CDP startup, target selection, and recovery. The local references/edge-cdp-control.md add-on retains Datasphere-specific boundaries. Use CDP for local read-only inspection of Data Builder, Business Builder, monitoring, connection, catalog, and admin UI state; ask before saving, deploying, deleting, importing, exporting, running task chains, or changing users/roles.

---

Quick Reference

Core Components

| Component | Purpose | Key Objects | |-----------|---------|-------------| | Data Builder | Data acquisition & preparation | Views, Tables, Flows, Task Chains | | Business Builder | Semantic layer modeling | Business Entities, Fact Models, Consumption Models | | Analytic Model | Analytics-ready structures | Dimensions, Facts, Measures, Hierarchies | | Connections | External data sources | 40+ connection types | | Spaces | Logical data containers | Storage, Users, Objects |

Object Types

Views:

• Graphical View: Visual data modeling with drag-and-drop
• SQL View: SQL-based view definitions
• Analytic Model: Analytics-optimized semantic layer

Tables:

• Local Table: Data stored in Datasphere
• Remote Table: Virtual access to external data
• Local Table (File): Object store-based storage

Flows:

• Data Flow: ETL transformations
• Replication Flow: Data replication from sources
• Transformation Flow: Delta-aware transformations

---

Data Builder

Graphical Views

Create views visually by dragging sources and adding transformations.

Supported Operations:

• Join: Inner, Left Outer, Right Outer, Full Outer, Cross
• Union: Combine multiple sources
• Projection: Select/rename columns
• Filter: Row-level filtering
• Aggregation: Group by with aggregates
• Calculated Columns: Derived values

Best Practices:

• Use input parameters for dynamic filtering
• Apply data access controls for row-level security
• Enable persistence for frequently accessed views
• Use lineage analysis to understand dependencies

For detailed graphical view operations, see references/graphical-sql-views.md.

SQL Views

Create views using SQL or SQLScript.

-- Basic SQL View
SELECT
    customer_id,
    customer_name,
    SUM(order_amount) AS total_orders
FROM orders
GROUP BY customer_id, customer_name

SQLScript Support:

• Table variables
• Scalar variables
• Control flow (IF, WHILE, FOR)
• Exception handling

For SQL/SQLScript reference, see references/graphical-sql-views.md.

Data Flows

ETL pipelines for data transformation and loading.

Operators:

• Source: Remote/local tables, views
• Target: Local tables
• Join, Union, Projection, Filter, Aggregation
• Script: Python custom logic
• Calculated Columns

Execution:

• Manual run or scheduled via task chains
• Delta capture for incremental loads
• Input parameters for runtime configuration

For data flow details, see references/data-acquisition-preparation.md.

Replication Flows

Replicate data from source systems to Datasphere or external targets.

Supported Sources:

• SAP S/4HANA (Cloud/On-Premise)
• SAP BW/4HANA
• SAP ECC
• ABAP-based systems
• Cloud storage (S3, Azure Blob, GCS)
• Kafka/Confluent
• SFTP

Supported Targets:

• SAP Datasphere (local tables)
• Apache Kafka
• Google BigQuery
• Cloud storage providers
• SAP Signavio

Load Types:

• Initial Load: Full data extraction
• Delta Load: Changed data only
• Real-Time: Continuous replication

For replication flow configuration, see references/data-acquisition-preparation.md.

Transformation Flows

Delta-aware transformations with automatic change propagation.

Key Features:

• Automatic delta detection
• Target table management
• Graphical or SQL view as source
• Run modes: Start, Delete, Truncate

For transformation flow details, see references/data-acquisition-preparation.md.

Task Chains

Orchestrate multiple tasks in sequence or parallel.

Supported Tasks:

• Data flows
• Replication flows
• Transformation flows
• Remote table replication
• View persistence
• Open SQL procedures
• API tasks
• BW Bridge process chains

Features:

• Parallel execution branches
• Input parameters
• Email notifications
• Nested task chains
• Scheduling (simple or cron)

---

Data Modeling

Analytic Models

Create analytics-ready semantic models for SAP Analytics Cloud.

Components:

• Fact: Contains measures (quantitative data)
• Dimension: Categorizes data (master data)
• Measure: Quantifiable metrics
• Hierarchy: Navigation structures
• Variable: Runtime parameters

Creating an Analytic Model:

1. Add a fact source (view or table)
2. Add dimension associations
3. Define measures with aggregation
4. Configure variables for filtering
5. Set data access controls

For detailed modeling guidance, see references/data-modeling.md.

Dimensions

Categorize and filter analytical data.

Types:

• Standard: Basic categorical data
• Time: Calendar-based filtering
• Fiscal Time: Custom fiscal calendars
• Text Entity: Multilingual labels

Features:

• Hierarchies (level-based, parent-child)
• Time dependency (SCD Type 2)
• Compound keys
• Associated text entities

Measures

Quantifiable values for analysis.

Types:

• Simple: Direct aggregation
• Calculated: Derived from other measures
• Restricted: Filtered aggregation
• Currency Conversion: Dynamic conversion
• Unit Conversion: Dynamic conversion
• Count Distinct: Unique value count
• Non-Cumulative: Point-in-time values

Aggregation Types:

• SUM, MIN, MAX, COUNT, AVG
• Exception aggregation for non-additive scenarios

For measure configuration, see references/data-modeling.md.

Business Builder

Create business-oriented semantic models.

Objects:

• Business Entity: Reusable dimension/fact definitions
• Fact Model: Combines business entities
• Consumption Model: Analytics-ready model
• Authorization Scenario: Row-level security

For Business Builder details, see references/data-modeling.md.

---

Connectivity

Connection Types

SAP Datasphere supports 40+ connection types.

SAP Systems:

• SAP S/4HANA Cloud/On-Premise
• SAP BW/4HANA (Model Transfer)
• SAP BW Bridge
• SAP ECC
• SAP HANA (Cloud/On-Premise)
• SAP SuccessFactors
• SAP Fieldglass
• SAP Marketing Cloud
• SAP Signavio

Cloud Platforms:

• Amazon S3, Athena, Redshift
• Google Cloud Storage, BigQuery
• Microsoft Azure Blob, Data Lake, SQL Database
• Microsoft OneLake

Databases:

• Oracle
• Microsoft SQL Server
• Generic JDBC

Streaming:

• Apache Kafka
• Confluent

Other:

• Generic OData, HTTP, SFTP
• Adverity, Precog
• SAP Open Connectors

For connection configuration, see references/connectivity.md.

Connection Features

| Feature | Description | |---------|-------------| | Remote Tables | Virtual data access | | Data Flows | ETL transformation | | Replication Flows | Data replication | | Model Import | BW/4HANA model transfer |

---

Administration

Spaces

Logical containers for data and objects.

Configuration:

• Storage allocation (disk + in-memory)
• User access and roles
• Priority and statement limits
• Workload management

Operations:

• Create, copy, delete spaces
• Export/import space data
• Command-line management (datasphere CLI)

For space management, see references/administration.md.

Users and Roles

Standard Roles:

• DW Administrator
• DW Space Administrator
• DW Integrator
• DW Modeler
• DW Viewer

Scoped Roles:

• Space-specific permissions
• Custom privilege combinations

Authentication:

• SAP Cloud Identity Services
• Custom SAML IdP
• OAuth 2.0 clients

For user management, see references/administration.md.

Monitoring

Capabilities:

• Capacity monitoring (storage, memory, compute)
• Audit logs (database operations)
• Activity logs (object changes)
• Task logs (flow executions)

Database Analysis:

• Create analysis users for debugging
• Monitor HANA views
• Stop running statements

For monitoring details, see references/administration.md.

---

Data Integration Monitor

Remote Tables

Operations:

• Replicate data (full/delta/real-time)
• Partition data loads
• Create statistics
• Monitor queries

Real-Time Replication

Features:

• Continuous change capture
• Pause/resume capability
• Automatic recovery
• Watermark tracking

View Persistence

Options:

• Scheduled refresh
• On-demand refresh
• Partition management
• Memory optimization

For monitoring details, see references/data-integration-monitor.md.

---

CLI Reference

Datasphere CLI Overview

The datasphere CLI enables command-line administration and automation.

Installation:

npm install -g @sap/datasphere-cli

Authentication:

# Interactive login
datasphere config auth login

# Service key (CI/CD)
datasphere config auth login --service-key-path ./key.json

Core Commands:

| Command | Purpose | |---------|---------| | datasphere spaces list | List all spaces | | datasphere spaces create | Create a space | | datasphere objects export | Export objects | | datasphere objects import | Import objects | | datasphere tasks run | Execute task chains | | datasphere marketplace list | List marketplace products |

CI/CD Integration:

# Export and import workflow
datasphere objects export --space DEV --output-file package.zip
datasphere objects import --space PROD --input-file package.zip --overwrite

For complete CLI reference, see references/cli-commands.md.

---

Data Products & Marketplace

Creating Data Products

Package curated data for internal or external consumption:

1. Plan: Define purpose, target consumers, contents
2. Prepare: Create views/models, set semantic usage, document
3. Configure: Set visibility, access controls, terms
4. Publish: Make available in marketplace

Product Components:

• Core assets (views, models, entities)
• Documentation and sample queries
• Governance metadata (owner, quality score, SLA)

Data Marketplace

Discover and consume published data products:

• Search: Find by category, provider, quality
• Request Access: Submit justification, await approval
• Consume: Use in views or SAC stories

For complete marketplace guidance, see references/data-products-marketplace.md.

---

Catalog & Governance

Data Catalog Features

Centralized discovery and governance:

• Asset Discovery: Search all data objects with metadata
• Glossary: Standardized business term definitions
• Data Quality: Automated quality rules and scoring
• Lineage: Trace data from source to consumption
• Classification: Sensitivity levels and compliance tags

Governance Workflow

Create Object → Add Metadata → Link Terms → Quality Check → Approve → Publish

Roles:

• Data Owner: Business accountability
• Data Steward: Quality and metadata management
• Data Custodian: Technical implementation

For detailed governance guidance, see references/catalog-governance.md.

---

Data Access Controls

Implement row-level security.

Types:

• Single Values: Simple value matching
• Operator and Values: Complex conditions
• Hierarchy: Node-based filtering
• Hierarchy with Directory: Hierarchical permissions

Application:

• Apply to views or analytic models
• Based on user attributes
• Import from SAP BW Analysis Authorizations

For security configuration, see references/data-access-security.md.

---

Content Transport

Move content between tenants.

Methods:

• Export/Import packages
• SAP Cloud Transport Management
• CSN/JSON file export

Package Contents:

• Views, tables, flows
• Connections (metadata only)
• Spaces configuration

For transport procedures, see references/content-transport.md.

---

---

Common Errors and Solutions

| Error | Cause | Solution | |-------|-------|----------| | Deployment failed | Circular dependency | Check object dependencies | | Connection timeout | Network/firewall | Verify Cloud Connector/IP allowlist | | Replication stuck | Source lock | Check source system status | | Out of memory | Large view | Enable persistence or partitioning | | Permission denied | Missing role | Verify space membership and privileges |

---

Bundled Resources

Reference Documentation

Core Data Builder:

1. references/data-acquisition-preparation.md - Data flows, replication flows, transformation flows, and table management
2. references/graphical-sql-views.md - Graphical views, SQL views, E-R models, and intelligent lookups
3. references/data-modeling.md - Business Builder entities, analytic models, dimensions, measures, and hierarchies

Connectivity & Integration: 4. references/connectivity.md - All 40+ connection types including SAP systems, cloud providers, and streaming platforms 5. references/data-integration-monitor.md - Task scheduling, monitoring, real-time replication, and delta mechanisms

Administration & Security: 6. references/administration.md - Tenant management, space configuration, user roles, and elastic compute nodes 7. references/data-access-security.md - Row-level security, DAC configurations, and authorization scenarios 8. references/content-transport.md - Package export/import, transport management, and tenant migration

CLI & Automation: 9. references/cli-commands.md - Complete CLI reference, authentication, CI/CD integration patterns

Marketplace & Governance: 10. references/data-products-marketplace.md - Creating and consuming data products, provider workflows, pricing 11. references/catalog-governance.md - Data catalog, glossary, quality rules, lineage, classification

Best Practices & Updates: 12. references/best-practices-patterns.md - Architecture patterns, naming conventions, performance optimization, checklists 13. references/whats-new-2025.md - 2025 archive: Q1-Q4 2025 features, Generic HTTP, REST API tasks, deprecations 14. references/whats-new-2026.md - 2026 Datasphere/BDC features, including Q1-Q2 updates and 2026.11 items such as HANA Cloud calculation-view semantic onboarding, replication-flow scheduling, runtime-settings transport, SAP Snowflake, and SAPPHIRE announcements

Platform Context: 15. references/business-data-cloud.md - SAP Business Data Cloud architecture, Databricks integration, data products vs. marketplace, BDC Connect

MCP Integration: 16. references/mcp-tools-reference.md - Complete MCP tool reference, 45 tools across 8 categories, API documentation, authentication patterns 17. references/mcp-use-cases.md - 8 illustrative source-material use cases with personas and planning assumptions 18. references/edge-cdp-control.md - Datasphere-specific add-on for the shared sap-browser-automation Edge/CDP and authentication layer

MCP Reference Routing

Search MCP references before loading them. Use rg -n "<space|view|connection|task|lineage|marketplace|governance|admin>" references/mcp-*.md to locate the exact tool or scenario, then open only that excerpt.

• Use references/mcp-tools-reference.md for tool names, inputs, and direct tenant-operation boundaries.
• Use references/mcp-use-cases.md only when choosing a workflow pattern or reviewing illustrative impact assumptions; do not load the full use-case guide for ordinary tool lookup.
• If MCP access is unavailable, fall back to the matching CLI/reference command and mark tenant checks pending.

Plugin Components

This plugin includes 3 specialized agents, 5 slash commands, and validation hooks:

Agents (in agents/):

• datasphere-modeler - Data Builder tasks, views, flows, analytic models
• datasphere-integration-advisor - Connectivity, replication, data integration
• datasphere-admin-helper - Space management, security, monitoring

Commands (in commands/):

• /datasphere-space-template - Generate space configurations
• /datasphere-view-template - Generate view templates (graphical/SQL)
• /datasphere-connection-guide - Step-by-step connection setup
• /datasphere-cli - CLI command reference and examples
• /datasphere-mcp-tools - SAP Datasphere MCP tool reference and usage guidance

Hooks (in hooks/):

• PreToolUse validation for SQL/SQLScript code quality
• PostToolUse suggestions for persistence and optimization

MCP Integration

This skill includes a connection recipe for the SAP Datasphere MCP Server (@mariodefe/sap-datasphere-mcp). The bundled MCP config uses the approved exact pin 1.2.1, governed by sap-dependency-security and validated by npm run validate:mcp-security; package evidence records 1.4.0 as an upgrade candidate. Treat MCP behavior and live tenant tool counts as pending until your harness loads the server and verifies the available tools.

| MCP detail | Value | |------------|-------| | Command | npx | | Args | -y @mariodefe/[email protected] | | Required env | DATASPHERE_BASE_URL, DATASPHERE_CLIENT_ID, DATASPHERE_CLIENT_SECRET, DATASPHERE_TOKEN_URL | | Operation safety | Tenant read tools plus mutating/destructive tools; ask before create, update, delete, reset, deploy, publish, or trigger operations | | Fallback | Use Datasphere CLI/reference guidance and mark live checks pending |

MCP Tools

The MCP server enables:

• Direct Queries: Execute SQL and smart queries on live data
• Metadata Access: Inspect tables, views, and analytic models
• User Management: Create, update, delete database users
• Catalog Search: Find assets by name or column
• Connection Testing: Verify connectivity and tenant info
• Data Profiling: Analyze column distributions

See /datasphere-mcp-tools command for complete tool list.

Authentication

OAuth 2.0 Client Credentials with automatic token refresh.

Required environment variables:

• DATASPHERE_BASE_URL
• DATASPHERE_CLIENT_ID
• DATASPHERE_CLIENT_SECRET
• DATASPHERE_TOKEN_URL

Performance

Performance depends on tenant size, network latency, payload size, permissions, and server version. Treat any example timings or batch limits in MCP reference material as illustrative until measured in the target tenant and recorded as evidence.

File Structure

plugins/sap-datasphere/
├── .claude-plugin/
│   └── plugin.json
├── .mcp.json                         # MCP server configuration
├── agents/
│   ├── datasphere-modeler.md
│   ├── datasphere-integration-advisor.md
│   └── datasphere-admin-helper.md
├── commands/
│   ├── datasphere-space-template.md
│   ├── datasphere-view-template.md
│   ├── datasphere-connection-guide.md
│   ├── datasphere-cli.md
│   └── datasphere-mcp-tools.md       # MCP tools reference
├── hooks/
│   └── hooks.json
└── skills/
    └── sap-datasphere/
        ├── .claude-plugin/
        │   └── plugin.json
        ├── SKILL.md
        ├── README.md
        └── references/
            ├── data-acquisition-preparation.md
            ├── data-modeling.md
            ├── graphical-sql-views.md
            ├── connectivity.md
            ├── administration.md
            ├── data-integration-monitor.md
            ├── data-access-security.md
            ├── content-transport.md
            ├── cli-commands.md
            ├── data-products-marketplace.md
            ├── catalog-governance.md
            ├── best-practices-patterns.md
            ├── whats-new-2025.md
            ├── whats-new-2026.md
            ├── business-data-cloud.md
            ├── mcp-tools-reference.md    # MCP technical reference
            ├── edge-cdp-control.md       # Edge CDP browser triage

Documentation Links

• SAP Help Portal: https://help.sap.com/docs/SAP_DATASPHERE
• Source Repository: https://github.com/SAP-docs/sap-datasphere
• SAP Community: https://community.sap.com/topics/datasphere
• API Reference: https://api.sap.com/package/saaborddatasphere

---