This topic provides the basic information and usage notes for calling the API operations of Data Lake Formation(DLF).Note For more information about how to call the API operations of Alibaba Cloud,see Use OpenAPI.Basic ...
This topic describes how to use the Data Lake Formation(DLF)and E-MapReduce(EMR)products to manage permissions on data lakes in specific business scenarios.Background information Metadata management and data permission ...
This topic describes how to authorize and manage Resource Access Management(RAM)users and roles in Data Lake Formation(DLF).Users and roles To access DLF,follow these steps:Grant the required RAM API access policy to the ...
This topic describes how to get started with Data Lake Formation(DLF).Prerequisites You have Set up DLF.Note The activation and authorization are performed only once when you first set up for DLF environment.To manage ...
Data Lake Formation(DLF)provides an alert feature using Cloud Monitor.You can set alert rules for key metrics to monitor the real-time status of lake table optimization.This helps you promptly handle potential risks and ...
Data Integration supports real-time synchronization of entire databases from sources such as MySQL,PostgreSQL,and OceanBase to Data Lake Formation(DLF).This topic describes how to synchronize an entire MySQL database to ...
This topic describes how to enable or disable overall permissions for the catalog.Procedure Enable permissions Log on to the Data Lake Formation console.In the left-side navigation pane,click Data Permission Permission ...
This topic describes how to use Data Lake Formation(DLF)to write data in a Hologres internal table back to Object Storage Service(OSS)by executing an SQL statement and then query the written data by using an external ...
This topic describes how to manage Object tables in Data Lake Formation(DLF).Create a table Log on to the DLF console.In the left navigation menu,select Catalogs.Click your catalog name to open the catalog details page.In ...
Build a data lakehouse by using MaxCompute,DLF,and OSS:If you use this method,all schemas of the data lake are stored in Data Lake Formation(DLF).MaxCompute can use the metadata management capability of DLF to efficiently ...
元数据检索是指通过构建一个高效且全面的索引系统，实现对数据湖中数据目录、数据库、表结构等信息进行快速定位与查询的过程。本文为您介绍在数据湖构建中如何进行元数据检索。操作步骤 登录 数据湖构建控制台。在左侧菜单栏，单击 元数据 ...
tables,and functions in data lake formation.Database Create a database Log on to the Data Lake Formation console.In the left-side navigation pane,select Metadata Metadata.Click the Database tab,select the target Catalog ...
The MaxCompute data lakehouse solution combines the flexibility of a data lake with the robust capabilities of a data warehouse.By integrating MaxCompute with Data Lake Formation(DLF),it establishes a comprehensive data ...
支持的数据源 来源数据源 去向数据源 ApsaraDB For OceanBase MySQL Oracle PolarDB PolarDB-X 2.0 MaxCompute MySQL Oracle PolarDB AnalyticDB for MySQL（V3.0）MySQL ApsaraDB for OceanBase MySQL Data Lake Formation(DLF)MySQL ...
新增授权 打开 数据湖构建控制台，并以数据湖管理员身份或已有授权权限的用户身份登录。在左侧菜单栏，单击 数据权限 数据授权。单击 新增授权，打开新增授权页面。指定 授权主体。主体类型：可以选择RAM用户/角色或DLF角色。RAM用户/角色...
湖元数据治理 Data Lake Formation(DLF)提供跨OSS、数据库、文件系统的统一元数据目录服务，支持自动元数据发现、细粒度权限控制、数据血缘追踪，简化湖内数据治理流程。全栈分析引擎 Spark、Hive、Presto/Trino 集成离线ETL（Spark/Hive）...
阿里云 DLF 即将开启商业化运营 阿里云数据湖构建（DLF）服务将于 2025 年 11 月下旬正式开启商业化运营。届时，DLF 将启动计费机制，并同步提供服务等级协议（SLA）保障。计费说明 商业化启动后，DLF 相关功能将按标准计费。详细费用信息...
Data Lake Formation(DLF)allows you to configure permissions on databases,tables,columns,and functions in data lakes.This topic describes the permissions that are required to perform different operations.This topic also ...
This topic describes how to build and manage a data lakehouse using MaxCompute,Data Lake Formation(DLF),and Object Storage Service(OSS).A data lakehouse integrates a data warehouse and a data lake to provide flexible and ...
and Avro formats.The metadata extraction process consumes computing power but does not incur fees.Procedure Log on to the Data Lake Formation console.In the left navigation bar,click Metadata Metadata Discovery.On the ...
time data writes,real-time data updates,and real-time data analysis.Based on these powerful engine capabilities,Hologres integrates with Data Lake Formation(DLF),Hive Metastore Service(HMS),OSS,and various ecosystem ...
This topic describes data overview of data tables.Description Data Lake Formation(DLF)provides detailed metrics for each data table based on the statistics of metadata and stored data.The metrics include the storage size ...
Data Lake Formation(DLF)is generally available by region starting December 16,2025.Introduction DLF is a fully managed platform that unifies metadata,data storage,and data management.It offers enterprise-grade security ...
通用服务 API 标题 API概述 GetRegionStatus 获取数据湖构建服务开通状态 获取数据湖构建指定地域的服务开通状态。GetServiceStatus 获取某个用户的服务开通状态 获取数据湖构建某个用户的服务开通状态。DescribeRegions 获取开通的地区 ...
This topic describes the basic operations on Iceberg tables in Data Lake Formation(DLF).Introduction Features Uses the Apache Iceberg table format,which follows the Apache Iceberg REST Catalog API standard.Use the Apache ...
The data centers of Data Lake Formation(DLF)reside in regions.Endpoints are the domain names that other services can use to access DLF.This topic describes the mappings between regions and endpoints.Regions and endpoints ...
本文为您介绍如何管理数据湖构建中已添加的用户。查看用户列表 登录 数据湖构建控制台。在左侧菜单栏，单击 数据权限 用户，可以查看当前账号下的所有RAM用户信息。说明 用户管理功能仅适用于RAM用户或角色。系统会自动添加当前账号下的...
This topic describes how to access a Data Lake Formation(DLF)catalog using Flink SQL via Iceberg REST.Prerequisites You have created a Realtime Compute for Apache Flink workspace.For instructions,see Activate Realtime ...
This topic describes how to access Data Lake Formation(DLF)from EMR Serverless Spark via PVFS.Version requirements This feature requires esr-3.5.0,esr-2.9.0,esr-4.6.0,and later.Create a DLF catalog See Get started with DLF...
感谢您一直以来对阿里云数据湖构建（DLF-Legacy）产品的支持与信任。为了能够更好地集中资源提升服务质量及用户体验，自2026年03月31日起，数据入湖将逐步在各地域下线。下线详情 下线时间：2026年03月31日 下线功能：DLF-Legacy产品的...
This topic describes the basic operations on Format tables in Data Lake Formation.Introduction Data management:DLF manages metadata and data files.Storage system:DLF automatically generates a data storage path based on a ...
✓ Programming languages Java None ✓ ✓ Python None ✓ ✓ Advanced features Native connection to Alibaba Cloud OSS None x ✓ Native connection to Alibaba Cloud Data Lake Formation(DLF)None x ✓ Data access acceleration ...
本文为您介绍数据湖构建中数据库的基本操作。说明 如果已经在其他平台上（如EMR、Flink等）关联了Catalog，也可在这些平台上创建数据库和表，元数据将会直接写入DLF中。详情请参见 引擎对接。新建数据库 登录 数据湖构建控制台。在 数据...
阿里云将对《数据湖构建服务（DLF-Legacy）服务级别协议》（“SLA”）进行修订。本次修订仅涉及将服务名称由“DLF”更新为“DLF-Legacy”，SLA 的其他条款内容均保持不变。修订后的 SLA 自北京时间 2025 年 9 月 30 日起正式生效。修订后的...
感谢您一直以来对阿里云数据湖构建（DLF-Legacy）产品的支持与信任。为了能够更好地集中资源提升服务质量及用户体验，自2026年03月31日起，数据探索将逐步在各地域下线。下线详情 下线时间：2026年03月31日 下线功能：DLF-Legacy产品的...
感谢您一直以来对阿里云数据湖构建（DLF-Legacy）产品的支持与信任。为了能够更好地集中资源提升服务质量及用户体验，自2026年03月31日起，湖格式管理将逐步在各地域下线。下线详情 下线时间：2026年03月31日 下线功能：DLF-Legacy产品的...
Register the OSS path to be managed by DLF....RegisterLocation*All Resources*none none Request syntax POST/webapi/locations ...Lake Formation read and write data in the OSS path.If you want to AliyunDLFWorkFlowDefaultRole a role...
Hologres works with Data Lake Formation(DLF)and Object Storage Service(OSS)to provide the data lake acceleration service.The service supports flexible data access and analysis and delivers efficient data processing ...
This topic describes how to add a table that uses a Data Lake Formation(DLF)data source.Prerequisites You are familiar with Data Lake Formation.You have configured a data catalog ID,a database,and a data table in DLF.They ...
本文介绍数据湖构建中各资源的计费规格，包括元数据对象存储、元数据请求、数据探索和湖管理优化。计量计费项 重要 DLF产品目前所有功能为 0折扣活动阶段，即使超过免费阶梯限定后，目前也均不会产生实际计费。元数据对象的存储量 元数据...