A data lake solution based on the combination of E-MapReduce(EMR)and Data Lake Formation(DLF)(EMR+DLF data lake solution)allows enterprises to manage the metadata and permissions of data lakes in a centralized manner.This ...
Location hosting allows you to manage and analyze the stored data in the data lake Object Storage Service(OSS)by hosting it to Data Lake Formation(DLF).After hosting the location,it will provide you with Storage overview,...
数据湖构建的数据表是实现实时离线一体化的核心。本文深度解析了内部表与外部表的本质区别、选型要点及其全生命周期管理，为构建高性能、易维护的现代数据湖奠定基础。
This topic provides the basic information and usage notes for calling the API operations of Data Lake Formation(DLF).Note For more information about how to call the API operations of Alibaba Cloud,see Use OpenAPI.Basic ...
This topic describes how to use the Data Lake Formation(DLF)and E-MapReduce(EMR)products to manage permissions on data lakes in specific business scenarios.Background information Metadata management and data permission ...
This topic describes how to authorize and manage Resource Access Management(RAM)users and roles in Data Lake Formation(DLF).Users and roles To access DLF,follow these steps:Grant the required RAM API access policy to the ...
湖元数据治理 Data Lake Formation(DLF)提供跨OSS、数据库、文件系统的统一元数据目录服务，支持自动元数据发现、细粒度权限控制、数据血缘追踪，简化湖内数据治理流程。全栈分析引擎 Spark、Hive、Presto/Trino 集成离线ETL（Spark/Hive）...
This topic describes how to get started with Data Lake Formation(DLF).Prerequisites You have Set up DLF.Note The activation and authorization are performed only once when you first set up for DLF environment.To manage ...
Data Integration supports real-time synchronization of entire databases from sources such as MySQL,PostgreSQL,and OceanBase to Data Lake Formation(DLF).This topic describes how to synchronize an entire MySQL database to ...
Data Lake Formation(DLF)provides an alert feature using Cloud Monitor.You can set alert rules for key metrics to monitor the real-time status of lake table optimization.This helps you promptly handle potential risks and ...
This topic describes how to use Data Lake Formation(DLF)to write data in a Hologres internal table back to Object Storage Service(OSS)by executing an SQL statement and then query the written data by using an external ...
Build a data lakehouse by using MaxCompute,DLF,and OSS:If you use this method,all schemas of the data lake are stored in Data Lake Formation(DLF).MaxCompute can use the metadata management capability of DLF to efficiently ...
This topic describes how to enable or disable overall permissions for the catalog.Procedure Enable permissions Log on to the Data Lake Formation console.In the left-side navigation pane,click Data Permission Permission ...
This topic describes how to manage Object tables in Data Lake Formation(DLF).Create a table Log on to the DLF console.In the left navigation menu,select Catalogs.Click your catalog name to open the catalog details page.In ...
元数据检索是指通过构建一个高效且全面的索引系统，实现对数据湖中数据目录、数据库、表结构等信息进行快速定位与查询的过程。本文为您介绍在数据湖构建中如何进行元数据检索。操作步骤 登录 数据湖构建控制台。在左侧菜单栏，单击 元数据 ...
tables,and functions in data lake formation.Database Create a database Log on to the Data Lake Formation console.In the left-side navigation pane,select Metadata Metadata.Click the Database tab,select the target Catalog ...
The MaxCompute data lakehouse solution combines the flexibility of a data lake with the robust capabilities of a data warehouse.By integrating MaxCompute with Data Lake Formation(DLF),it establishes a comprehensive data ...
EMR on ACK支持使用数据湖元数据DLF（Data Lake Formation）和自建Hive Metastore元数据两种方式，为Spark集群设置元数据。本文为您介绍如何在EMR on ACK中设置Spark集群的元数据。背景信息 因为数据湖元数据DLF具有高可用和易维护的特点，...
新增授权 打开 数据湖构建控制台，并以数据湖管理员身份或已有授权权限的用户身份登录。在左侧菜单栏，单击 数据权限 数据授权。单击 新增授权，打开新增授权页面。指定 授权主体。主体类型：可以选择RAM用户/角色或DLF角色。RAM用户/角色...
本文主要介绍数据湖构建（DLF）的权限体系，重点阐述如何为RAM用户（子账号）授予适当权限，以确保其能够正确使用和访问DLF的各项功能。数据湖构建（DLF）的权限体系分为API权限与DLF数据权限两类。如果您要访问DLF的页面或数据，通常都...
阿里云 DLF 即将开启商业化运营 阿里云数据湖构建（DLF）服务将于 2025 年 11 月下旬正式开启商业化运营。届时，DLF 将启动计费机制，并同步提供服务等级协议（SLA）保障。计费说明 商业化启动后，DLF 相关功能将按标准计费。详细费用信息...
感谢您一直以来对阿里云数据湖构建（DLF）产品的支持与信任。为了能够更好地集中资源提升服务质量及用户体验，自2023年2月15日起，我们停止更新DLF产品的“数据入湖”功能。DLF产品的 其他功能正常使用，不会受到任何影响。停止更新详情 ...
Data Lake Formation(DLF)allows you to configure permissions on databases,tables,columns,and functions in data lakes.This topic describes the permissions that are required to perform different operations.This topic also ...
This topic describes how to build and manage a data lakehouse using MaxCompute,Data Lake Formation(DLF),and Object Storage Service(OSS).A data lakehouse integrates a data warehouse and a data lake to provide flexible and ...
time data writes,real-time data updates,and real-time data analysis.Based on these powerful engine capabilities,Hologres integrates with Data Lake Formation(DLF),Hive Metastore Service(HMS),OSS,and various ecosystem ...
and Avro formats.The metadata extraction process consumes computing power but does not incur fees.Procedure Log on to the Data Lake Formation console.In the left navigation bar,click Metadata Metadata Discovery.On the ...
This topic describes data overview of data tables.Description Data Lake Formation(DLF)provides detailed metrics for each data table based on the statistics of metadata and stored data.The metrics include the storage size ...
Data Lake Formation(DLF)is generally available by region starting December 16,2025.Introduction DLF is a fully managed platform that unifies metadata,data storage,and data management.It offers enterprise-grade security ...
通用服务 API 标题 API概述 GetRegionStatus 获取数据湖构建服务开通状态 获取数据湖构建指定地域的服务开通状态。GetServiceStatus 获取某个用户的服务开通状态 获取数据湖构建某个用户的服务开通状态。DescribeRegions 获取开通的地区 ...
This topic describes the basic operations on Iceberg tables in Data Lake Formation(DLF).Introduction Features Uses the Apache Iceberg table format,which follows the Apache Iceberg REST Catalog API standard.Use the Apache ...
The data centers of Data Lake Formation(DLF)reside in regions.Endpoints are the domain names that other services can use to access DLF.This topic describes the mappings between regions and endpoints.Regions and endpoints ...
本文为您介绍如何管理数据湖构建中已添加的用户。查看用户列表 登录 数据湖构建控制台。在左侧菜单栏，单击 数据权限 用户，可以查看当前账号下的所有RAM用户信息。说明 用户管理功能仅适用于RAM用户或角色。系统会自动添加当前账号下的...
This topic describes how to access Data Lake Formation(DLF)from EMR Serverless Spark via PVFS.Version requirements This feature requires esr-3.5.0,esr-2.9.0,esr-4.6.0,and later.Create a DLF catalog See Get started with DLF...
感谢您一直以来对阿里云数据湖构建（DLF-Legacy）产品的支持与信任。为了能够更好地集中资源提升服务质量及用户体验，自2026年03月31日起，数据入湖将逐步在各地域下线。下线详情 下线时间：2026年03月31日 下线功能：DLF-Legacy产品的...
This topic describes how to access a Data Lake Formation(DLF)catalog using Flink SQL via Iceberg REST.Prerequisites You have created a Realtime Compute for Apache Flink workspace.For instructions,see Activate Realtime ...
This topic describes the basic operations on Format tables in Data Lake Formation.Introduction Data management:DLF manages metadata and data files.Storage system:DLF automatically generates a data storage path based on a ...
✓ Programming languages Java None ✓ ✓ Python None ✓ ✓ Advanced features Native connection to Alibaba Cloud OSS None x ✓ Native connection to Alibaba Cloud Data Lake Formation(DLF)None x ✓ Data access acceleration ...
本文为您介绍数据湖构建中数据库的基本操作。说明 如果已经在其他平台上（如EMR、Flink等）关联了Catalog，也可在这些平台上创建数据库和表，元数据将会直接写入DLF中。详情请参见 引擎对接。新建数据库 登录 数据湖构建控制台。在 数据...
阿里云将对《数据湖构建服务（DLF-Legacy）服务级别协议》（“SLA”）进行修订。本次修订仅涉及将服务名称由“DLF”更新为“DLF-Legacy”，SLA 的其他条款内容均保持不变。修订后的 SLA 自北京时间 2025 年 9 月 30 日起正式生效。修订后的...