51CTO首页
AI.x社区
博客
学堂
精品班
软考社区
免费课
企业培训
鸿蒙开发者社区
WOT技术大会
IT证书
公众号矩阵
移动端
短视频 免费课程 课程排行 直播课 软考学堂
全部课程 厂商认证 IT技术 24年11月软考 PMP项目管理 免费题库
在线学习
文章 资源 问答 课堂 专栏 直播
51CTO
鸿蒙开发者社区
51CTO技术栈
51CTO官微
51CTO学堂
51CTO博客
CTO训练营
鸿蒙开发者社区订阅号
51CTO软考
51CTO学堂APP
51CTO学堂企业版APP
鸿蒙开发者社区视频号
51CTO软考题库
# Hadoop

Upgrade Cloudera Manager and CDH 5.2.1 to 5.3.0

Upgrade Cloudera Manager 5.2.1 to 5.3.01. Stop the Cloudera Management Service2. Stop the Hive service and all services such as Impala and Hue that use the Hive metastore.3. Backup MySQL Databases (m

cloudera
原创 2014-12-23 14:43:46 1041 阅读

Upgrade Cloudera Manager and CDH to 5.2.1

Upgrade Cloudera Manager to 5.2.11. Stop the Cloudera Management Service2. Stop the Hive service and all services such as Impala and Hue that use the Hive metastore.3. Backup MySQL Databases (mysqldu

cdh
原创 2014-12-02 16:06:16 967 阅读

Setup Alert, Configure Monitoring and Disable Sending Usage and Diagnostic Data to Cloudera

Setup Alert Email settings:Disable Sending Usage and Diagnostic Data to ClouderaConfigure Service/Host Monitoring setting:ok

support
原创 2014-11-27 16:56:41 10000+阅读

Enabling HDFS/YARN HA and Other CDH Components to Use HDFS HA with Cloudera Manager 5.2

Enabling HDFS HAConfiguring HBase to Use HDFS HAnothing to doUpgrading the Hive Metastore to Use HDFS HAConfiguring Hue to Work with HDFS HAadd HttpFS role instance under HDFSRestart the Hue serviceCo

ha
原创 2014-11-26 10:00:17 1410 阅读

Configuring TLS Encryption Only for Cloudera Manager and Level 1

Configuring TLS Encryption Only for Cloudera Manageron Cloudera Manager Server:1. mkdir -p /opt/cloudera/security/{x509,jks,CAcerts}2. generate a Java keystore and Certificate Signing Request (CSR) fo

tls
原创 2014-11-21 14:13:42 1652 阅读 2点赞 2评论

Enabling the Oozie Web Console and use MySQL Database in Cloudera Manager 5.2

1. on Oozie server:cd /var/lib/oozieunzip -x /root/ext-2.2.zipchown -R oozie:oozie ext-2.2restart Oozie serviceon MySQL server:create database oozie;grant all privileges on oozie.* to 'oozie'@'localho

web
oozie
原创 2014-11-14 14:30:24 916 阅读

CentOS 6.5 编译Eclipse plugin for hadoop 2.5及加载连接

1. rpm -ivh jdk-7u67-linux-x64.rpmcd /opttar zxf /root/hadoop-2.2.0.tar.gztar zxf /root/apache-ant-1.9.4-bin.tar.gztar zxf /root/apache-maven-3.2.3-bin.tar.gztar zxf /root/eclipse-java-luna-SR1-linux-

eclipse
plugin
原创 2014-11-13 14:50:21 1551 阅读

消除CDH5.2 Accumulo Under-Replicated Blocks

安装Accumulo 1.6，参考http://www.cloudera.com/content/cloudera/en/documentation/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf在Cloudera Manager发现HDFS有警告，使用sudo -u hdfs hdfs fsck -blocks 发现类似错误：

accumulo
原创 2014-11-12 11:55:08 3205 阅读

Configure Solr in HUE

1. Deploying Solr with Hue restart HUE service2. delete old example indexes from HUE3. On Solr Server:cd /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/lib/hue/apps/search/examples/bin./create_colle

hue
solr
原创 2014-11-03 14:42:02 3593 阅读

Configure HUE to store data in MySQL

on MySQL server:create database hue;grant all on hue.* to 'hue'@'localhost' identified by 'hue';grant all on hue.* to 'hue'@'%' identified by 'hue';stop HUE servicestart HUE service

mysql
hue
原创 2014-11-01 13:44:29 742 阅读

Enable DB Query in HUE web UI

put configuration in HUE as below:[librdbms]  # The RDBMS app can have any number of databases configured in the databases  # section. A database is known by its section name  # (IE sql

hue
原创 2014-10-31 15:12:50 5545 阅读

Using Sqoop2 to import mysql data to HDFS

On Sqoop2 server:MySQL JDBC Driver:cp mysql-connector-java-5.1.33/mysql-connector-java-5.1.33-bin.jar /var/lib/sqoop2/mysql-connector-java.jarOracle JDBC Driver:cp ojdbc6.jar /var/lib/sqoop2/oracle-co

sqoop2
原创 2014-10-31 13:23:30 3136 阅读

Install Kafka service to Cloudera Manager 5.2

On Cloudera Manager Server:1. download kafka csd and parcel file from http://archive-primary.cloudera.com/cloudera-labs/2. copy kafka csd file to /opt/cloudera/csd/3. service cloudera-scm-server resta

kafka
原创 2014-10-29 13:11:29 1089 阅读

HUE Integrate with Active Directory

1. Create hueadmin(same as hueadmin as you first create admin account) and hdfs account in Active Directory2. 命令行仅供参考[ vi /etc/hue/conf/hue.ini`auth`   backend=desktop.auth.backend.LdapBacke

hue
原创 2014-10-28 14:39:44 986 阅读

Hadoop 性能测试工具

su - hdfsPI Estimator Testing:hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100TeraGen/TeraSort/TeraValidate Testing:1. hadoop jar /opt/cloudera/parcels

benchmarking
原创 2014-10-28 09:19:08 10000+阅读

Install Client Node for Cloudera Manager Hadoop Cluster

分区考虑，不要使用LVMroot -- >50Gopt -- >50G/tmp -- >100G (run job失败的话请查看此目录空间)swap -- 2倍系统内存RAM -- >8GB1. disable selinux and iptablesservice iptables stopchkconfig iptables off; chkconfig ip6tabl

hadoop
原创 2014-10-27 10:53:34 881 阅读

hadoop硬件需求及node计算

Hadoop Effective Space = (MaxAllocFactor * DiskSize * ( #Disk – RaidDisks ) ) / ReplicationFactorMaxAllocFactor = Max recommended allocation, 75% for HadoopDiskSize = Size of your drive#Disk = Number

hadoop
原创 2014-10-23 17:34:00 1203 阅读

Cloudera Manager 日常操作

HDFS URI: hdfs://active-namenode[:8020]/  or hdfs://nameservice-name/Web Interface:hadoop namenode: 50070hadoop secondarynode: 50090hadoop yarn ResourceManager: 8088hadoop yarn NodeManager: 8042h

hadoop
日常操作
原创 2014-10-23 16:41:39 9552 阅读

Install hadoop with Cloudera Manager 5.2 using Parcel on CentOS 6.5

主机分配考虑：master:HDFS NameNode 1 + HDFS NameNode 2YARN ResourceManager 1 + YARN ResourceManager 2slave: (these roles co-deployed)HDFS DataNode + YARN NodeManager + HBase RegionServer + Impala Daemonother

cloudera
原创 2014-10-17 11:34:10 2436 阅读

Install Hadoop with HDP 2.2 on CentOS 6.5

Hadoop HortonworksMasters-- HDFS NameNode, YARN ResourceManager (ApplicationsManager + Scheduler), and HBase MasterSlaves-- HDFS DataNodes, YARN NodeManagers, and HBase RegionServers (Worker Nodes co-

hadoop
原创 2014-09-11 13:11:47 2259 阅读

Copyright © 2005-2024 51CTO.COM 版权所有 京ICP证060544号

关于我们
官方博客 全部文章 热门标签 班级博客
了解我们 网站地图 意见反馈
友情链接
鸿蒙开发者社区 51CTO学堂
51CTO 软考资讯