Hadoop 集群安装前应该对服务器的内核参数进行设置,以提高性能(网络/CPU)。同时对磁盘、NTP、DNS等进行检查,推荐使用ansible进行批量操作。
-
NGINX gzip compression fix
NGINX 代理的的web 加载速度优化.
-
spring-boot2 config logging
spring boot config logging pattern/logger-level/file
-
HDFS missing block 问题处理记录
IDC 机房出现重大故障,导致Hadoop HDFS missing block 问题的处理过程及记录
-
PostgreSQL Demo
postgres start and SQL demo
-
Apache Ranger 2.1 compile
apache maven ranger compile 笔记
-
Hadoop disctp -- kerberos cluster to nosecure cluster
HDFS 跨集群拷贝注意点:kerberos集群和非kerberos集群间的拷贝
-
HBase Major Compaction 优化
HBase RegionServer Major Compaction Turing
-
Datanode Initialization failed ——— NetworkTopology error
HDFS DataNode Initialization failed - You cannot have a rack and a non-rack node at the same level of the network topology.
-
Spark输出处理-文本数据
spark 处理大文本数据集