DatahubClientError-其他所有，并且是所有异常的基类 InvalidParameterError InvalidParameter InvalidCursor 非法参数 代码示例 func meter(dh datahub.DataHub,projectName,topicName string){ shardId:="0"gmi,err:=dh.GetMeterInfo...
本文为您展示DataHub的 Java SDK的Meter 操作。获取Meter 参数说明 参数名 参数类型 参数说明 projectName String 项目名称。topicName String Topic名称。shardId String The id of the shard.异常说明 异常类名 错误码 异常说明 ...
安装 C++ 前置条件 DataHub使用C++SDK必须使用GCC4.9.2编译，请确保编译环境通过后再安装使用。C++ SKD下载 C++ 2.13.0版本 下载。C++ 2.14.0版本 下载。C++ 2.15.0版本 下载。C++ 2.23.0版本 下载。C++ 2.25.0版本 下载。初始化环境 您...
Topic说明 Topic是 DataHub 订阅和发布的最小单位，用户可以用Topic来表示一类或者一种流数据，目前支持Tuple与Blob两种类型：Blob类型Topic支持写入一块二进制数据作为一个Record。Tuple类型的Topic支持类似于数据库的记录的数据，每条...
创建Project 登录 DataHub WebConsole 页面，创建Project 或使用SDK接口进行创建 初始化DataHub import sys import traceback from datahub import DataHub from datahub.exceptions import ResourceExistException from datahub.models ...
本文为您展示DataHub的 Java SDK的读写数据操作。前提条件 状态为 CLOSED 和 ACTIVE 的 shard 可以读取数据。状态为 ACTIVE 的 shard 可以写数据。重要 如无特殊需求，建议使用High-Level SDK 进行读写操作，High-Level SDK 是对 Low-Level...
DatahubClientError-其他所有，并且是所有异常的基类 InvalidParameterError InvalidParameter InvalidCursor 非法参数 代码示例 func createProjet(dh datahub.DataHub,projectName string){ if err:=dh.CreateProject(projectName,...
本文为您展示DataHub的 Java SDK的Project操作。创建Project 创建Project需要提供Project的名字和描述，Project的名字长度限制为[3,32]，必须以英文字母开头，仅允许英文字母、数字及“_”，大小写不敏感。参数说明 参数名 参数类型 参数...
阿里云临时安全令牌（Security Token Service，STS）是阿里云提供的一种临时访问权限管理服务。...dependency groupId .../groupId artifactId aliyun-sdk-datahub/artifactId version 2.19.0-public /version /dependency参考示例...
本文为您展示DataHub的 C++ SDK的Project操作。创建Project 参数说明 参数名 参数类型 参数说明 projectName String 项目名称。comment String 项目描述。示例代码 void CreateProject(){ std:string projectName=";std:string comment=";...
本文为您展示DataHub的 C++ SDK的offset操作。初始化Offset 参数说明 参数名 参数类型 参数说明 projectName String 项目名称。topicName String Topic名称。subId string shardIds 代码示例 void InitSubscriptionOffsetSession(){ const ...
代码示例 func openOffset(dh datahub.DataHub,projectName,topicName string){ subId:="1565580329258VXSY8"shardIds:=[]string{"0","1","2"} oss,err:=dh.OpenSubscriptionSession(projectName,topicName,subId,shardIds)if err!...
代码示例 func delSubscription(dh datahub.DataHub,projectName,topicName string){ subId:="1565577384801DCN0O"if err:=dh.DeleteSubscription(projectName,topicName,subId);err!nil { fmt.Println("delete subscription failed")...
Activate the DataHub service before performing operations such as reading and writing data.This topic describes the activation process.Procedures Go to the DataHub product page and click Activate Now.Select Region and ...
related parameters Parameter Default value Required Description datahub.endPoint-Yes The endpoint of DataHub.datahub.accessId-Yes The AccessKey ID of your Alibaba Cloud account.datahub.accessKey-Yes The AccessKey secret of...
AliyunServiceRoleForDataHubDWConnection is the service-linked role for DataHub-DataWorks Connection.This topic describes the application scenarios of the service-linked role and how to delete the service-linked role.The ...
本文为您展示DataHub的 C++ SDK的读写数据操作。读数据 获取cursor 读取Topic下的数据，需要指定对应的shard，同时需要指定数据读取的游标位置Cursor。Cursor的获取方式有以下四种：OLDEST:表示获取的cursor指向当前有效数据中时间最久远的...
you must manually authorize DataHub to access Alibaba Cloud services.Data synchronization Service-linked role for DataHub Descriptions added to fields during schema creation Descriptions can be added to fields when you ...
false 表示在当前 consumer 所消费的 shard 中选择点位最老的 shard 发送读请求，主要是防止在数据倾斜场景下 shard 点位差距过大 autoCommit bool 否 true 是否自动 ack 数据：true 表示数据 read 到以后自动 ack；false 表示数据 read 到...
本文为您展示DataHub的 C++ SDK的Connector操作。创建 Connector 参数说明 参数名 参数类型 参数说明 projectName String 项目名称。topicName String Topic名称。代码示例（ODPS）void CreateConnector(){ try{ sdk:SinkOdpsConfig config...
Dear Alibaba Cloud users,Since March 31,2025(UTC+8),the unit price of read traffic of DataHub is reduced from USD 0.024 per GB to USD 0.0024 per GB,a 90%decrease.The price adjustment is to meet the increasing scale of ...
AliyunServiceRoleForDataHub is the service-linked role for DataHub.This topic describes the scenarios of the service-linked role and how to delete the service-linked role.Service-linked role for DataHub ...
本文为您展示DataHub的 C++ SDK的Subscription操作。创建 Subscription 参数说明 参数名 参数类型 参数说明 projectName string 项目名称。topicName string Topic名称。代码示例 void CreateSubscription(){ std:string projectName=";std...
CreateTupleTopic(dh datahub.DataHub,projectName,topicName string){ recordSchema:=datahub.NewRecordSchema()recordSchema.AddField(datahub.Field{Name:"bigint_field",Type:datahub.BIGINT,AllowNull:true}).AddField(datahub.Field{...
Dear Alibaba Cloud users,To meet the increasing scale of streaming data that needs to be processed in different regions,DataHub is available in the China(Ulanqab)region starting from May 14,2025(UTC+8).Supported regions of...
DataHub plug-in for Fluentd Overview The DataHub plug-in for Fluentd,an output plug-in developed based on Fluentd,writes collected data to DataHub.The plug-in complies with the development conventions of Fluentd output ...
Community articles on DataHub This topic lists the articles that the DataHub team published in Yunqi Community.You can read these articles to understand and learn how to use DataHub.DataHub operation guide DataHub user ...
go get-u-insecure github.com/aliyun/aliyun-datahub-sdk-go/datahub Initialize the DataHub client All API operations in the DataHub Go SDK are implemented through the datahub.DataHub interface.The first step is to create a ...
Synchronize data to MaxCompute Preparations 1.Create a MaxCompute table DataHub allows you to synchronize data to MaxCompute tables.Both partitioned and non-partitioned tables are supported.To facilitate data processing in...
You are welcome to join the DingTalk group for DataHub users.DingTalk group for DataHub users Scan the following QR code to join the DingTalk group for DataHub users.
DataHub is an Alibaba Cloud platform for processing streaming data.It enables you to publish,subscribe to,and distribute data streams to build data analytics and applications.Product overview DataHub is a streaming data ...
DataHub supports alert notifications through CloudMonitor.You can create alert rules to monitor and receive alert notifications for DataHub metrics.The supported metrics include readMetric,writeMetric,and Subscription and ...
Rules on overdue payments A one-day late payment does not affect your paid services of DataHub.If your bill is overdue for more than one day but fewer than or equal to seven days,the services related to projects and topics...
This topic describes the preparation steps before using DataHub.Procedures Step 1:Create an Alibaba Cloud account.Step 2:Activate the DataHub service.Step 3:Create a project and topic.
and databases to DataHub in real time for unified data management.The data is then delivered to downstream systems for data analysis and archiving.DataHub helps you create a clear data flow that better unlocks the ...
Step 1:Activate DataHub Log on to the DataHub console.Activate DataHub as prompted.Step 2:Create a project and a topic Log on to the DataHub console.On the Project List page,click Create Project in the upper-right corner ...
1.Access control 1.1 Authentication DataHub supports multiple identity types,including Alibaba Cloud accounts,RAM users,and RAM roles.It also supports authentication using AccessKey ID and AccessKey Secret,Multi-Factor ...
CreateTupleTopic(dh datahub.DataHub,projectName,topicName string){ recordSchema:=datahub.NewRecordSchema()recordSchema.AddField(datahub.Field{Name:"bigint_field",Type:datahub.BIGINT,AllowNull:true}).AddField(datahub.Field{...
the service-linked role for DataHub is automatically created.Then,DataHub uses the service-linked role to synchronize data to OTS.Procedure:In the left-side navigation pane of the DataHub console,click Project Manager.On ...
You can use the DataHub plug-in for Oracle GoldenGate(OGG)to collect Oracle data based on OGG Application Adapters or OGG for Big Data.The difference between the two modes is that different processes are used in the ...