DLF（Data Lake Formation，数据湖构建）、OSS（对象存储）和Hologres位于云产品互联网络中，MaxCompute无需设置网络连接对象Networklink即可直接访问其中的数据。外部数据源（Foreign Server）包含了元数据和数据访问的信息，同时包含访问...
As the unified data lake foundation of Alibaba Cloud,Data Lake Formation(DLF)integrates with mainstream big data compute engines.This provides powerful support for diverse business scenarios,such as real-time and offline ...
end data ingestion and analysis practice based on Alibaba Cloud Data Lake Formation(DLF).Background information With the continuous development of the data era,the volume of data is growing explosively,and the forms of ...
DLF-Auth组件是数据湖构建DLF（Data Lake Formation）产品提供的，通过该组件可以开启数据湖构建DLF的数据权限功能，可以对数据库、数据表、数据列、函数进行细粒度权限控制，实现数据湖上统一的数据权限管理。本文为您介绍如何开启DLF-...
Dear users,Thank you for your support and trust in Alibaba Cloud Data Lake Formation(DLF).From February 15,2023,Alibaba Cloud no longer updates the data ingestion feature provided by DLF.This aims to improve service ...
数据湖构建 DLF 服务等级协议（SLA）的详情，请参见 数据湖构建DLF服务等级协议。
Alibaba Cloud Data Lake Formation(DLF)is a fully managed platform that provides unified metadata,data storage,and data management.DLF offers features such as metadata management,storage management,permission management,...
Data Lake Formation(DLF)1.0 is a fully managed service that helps users quickly build cloud-based data lakes and lakehouses.This service provides customers with unified metadata management,unified permission and security ...
Data Lake Formation(DLF)is launching its free public preview from August 5,2025.This is a valuable opportunity to explore the latest advancements in DLF.We welcome all users to join,provide feedback,and help us make DLF ...
Overview The Paimon client supports PVFS(Paimon Virtual Storage)that allows users to access tables in a Data Lake Formation(DLF)catalog using standard file paths,similar to a regular file system.How it works PVFS abstracts...
Data Lake Formation,and Object Storage Service:The metadata(schema)of the data lake is stored in Data Lake Formation(DLF).MaxCompute uses the metadata management capabilities of DLF to improve data processing for semi-...
自2021年1月起，数据湖构建（DLF）服务等级协议（SLA）生效。详细内容参考 数据湖构建服务等级协议。
This topic describes the Data Lake Formation(DLF)permission model,including how to grant permissions to a Resource Access Management(RAM)user.This allows them to access and use DLF features.The permission model has two ...
This topic describes how to get started with Data Lake Formation(DLF).Prerequisites All the data in data lakes that are created by using DLF is stored in Object Storage Service(OSS).You must specify an OSS bucket or an OSS...
数据目录（Catalog）是数据湖构建（Data Lake Formation）的元数据顶层逻辑实体，采用层级化结构组织元数据资源。适用于不同业务或不同用户间的元数据隔离与权限管控，以及湖数据存储和湖表运维管理等场景。本文为您介绍数据目录（Catalog...
背景信息 阿里云数据湖构建（Data Lake Formation，简称DLF）是阿里云官方提供的一款统一元数据管理的产品。您可以方便地借助DLF产品来管理创建的表格，这些表格的格式可以是开源格式，例如Iceberg、Hudi、Delta、Parquet、ORC或Avro等。...
MaxCompute基于阿里云DLF（Data Lake Formation）、RDS（Relational Database Service）或Flink、OSS（Object Storage Service）产品提供了支持Delta Lake或Hudi存储机制的湖仓一体架构，架构图如下。模块 对应阿里云产品 说明 在线数据库 ...
此外，请按需开通对应地域的数据湖构建服务，即可顺利使用DLF功能。云资源访问授权 通常情况下，首次使用DLF时，您需要完成自动化授权操作，确保DLF能够正常访问相关云资源。登录 数据湖构建控制台。在 云资源访问授权 右侧，单击 授权。在...
OSS Data storage class:OSS-HDFS Data storage class:HDFS Data Lake cluster(DataLake)Data Lake Formation(DLF)RDS instance MySQL Custom cluster(Custom)Data Lake Formation(DLF)RDS instance MySQL Other clusters-Why are queries ...
We're excited to announce that Data Lake Formation(DLF)is now available for free invitational preview,starting from April 17,2025.This is a valuable opportunity to experience the latest advancements in DLF.We invite all ...
Data Lake Formation(DLF)offers a unified,fully managed platform for data and metadata management,and storage.In addition,it provides data access control and storage analysis and optimization.DLF seamlessly integrates with ...
系统内置角色：admin（数据湖管理员）：拥有数据湖构建中，所有的数据权限及授权权限。super_administrator（超级管理员）：拥有数据湖构建中，所有的数据权限及授权权限，可以对admin的用户进行修改。创建角色 在角色列表页面，单击 创建...
EMR-3.30.0 Hive 2.3.5 支持阿里云DLF（Data Lake Formation）元数据。解决了读Delta表空目录时写DUMMY文件问题。升级HAS依赖至2.0.1。EMR-3.29.0 Hive 2.3.5 Hive升级至2.3.5.6.0。支持第三方Metastore的功能。增加datalake metastore-...
This topic describes the limits of Data Lake Formation(DLF).When you use the DLF console or call API operations,make sure that relevant requirements are met.Otherwise,an error occurs.Metadata Item Quota Queries on a single...
本文介绍数据湖构建中各资源的计费规格，包括元数据对象存储、元数据请求、数据探索和湖管理优化。计量计费项 重要 DLF产品目前所有功能为 0折扣活动阶段，即使超过免费阶梯限定后，目前也均不会产生实际计费。元数据对象的存储量 元数据...
本文介绍召回引擎版实例添加表选择数据湖构建（DLF）数据源的步骤详情。前置条件 了解 数据湖构建。已配置数据湖构建 数据目录ID、数据库 和 数据表，将在配置数据同步中使用。添加数据湖（DLF）数据源 在 实例详情 表管理页，点击 添加表...
本文为您介绍使用数据湖构建OpenAPI的基本信息及注意事项。说明 关于如何使用阿里云OpenAPI，请参见学习文档：使用OpenAPI。基本信息 版本说明 版本号 说明 2020-07-10 推荐 接入点说明 参见 服务接入点。用户身份 用户身份 支持情况 阿里...
This topic describes the basic database operations in Data Lake Formation(DLF).Note When a DLF catalog is registered in platforms like EMR Serverless Spark or Realtime Compute for Apache Flink,you can create databases and ...
Data Lake Formation(DLF)can work with the Realtime Compute for Apache Flink service built on the Ververica Platform(VVP)computing engine and the Flink Change Data Capture(CDC)technology to import data to data lakes.You can...
This topic describes the frequently asked questions(FAQ)about Data Lake Formation(DLF)and provides answers to these questions.How do I apply for the public preview qualification of DLF?How can I estimate the number of CUs ...
The data catalog is the top-level entity of metadata in Data Lake Formation(DLF).It can contain multiple databases.This topic describes the basic operations of the data catalog.Scenarios The data catalog is used in the ...
Before users can use Data Lake Formation(DLF),you(administrators)must configure two types of permissions for them.This topic guides you through that task.Configure API permissions To interact with DLF through APIs or SDKs,...
and the policy statement elements(Action,Resource,and Condition)defined by Data Lake Formation for RAM permission policies.The RAM code(RamCode)for Data Lake Formation is dlf,and the supported authorization granularity is ...
A data catalog is the top-level metadata entity in Data Lake Formation(DLF)or Hive Metastore(HMS)and can contain multiple databases.In EMR Serverless Spark,you can view the databases and tables in an attached data catalog ...
This topic describes the basic operations on Lance tables in Data Lake Formation(DLF).Create a table Log on to the DLF console.In the left navigation menu,select Catalogs,and click your catalog name.In the Database section...
A data lake solution based on the combination of E-MapReduce(EMR)and Data Lake Formation(DLF)(EMR+DLF data lake solution)allows enterprises to manage the metadata and permissions of data lakes in a centralized manner.This ...
Location hosting allows you to manage and analyze the stored data in the data lake Object Storage Service(OSS)by hosting it to Data Lake Formation(DLF).After hosting the location,it will provide you with Storage overview,...
数据湖构建的数据表是实现实时离线一体化的核心。本文深度解析了内部表与外部表的本质区别、选型要点及其全生命周期管理，为构建高性能、易维护的现代数据湖奠定基础。