程序笔记   发布时间:2022-07-13  发布网站:大佬教程  code.js-code.com
大佬教程收集整理的这篇文章主要介绍了syslog大佬教程大佬觉得挺不错的,现在分享给大家,也给大家做个参考。
2021-08-23 13:38:29,139 WARN org.apache.hadoop.mapred.Child: <br>Heap Memory used 16.51 MB is  1% of Commited Heap Memory 1.54 GB. Max Heap Memory is 1.54 GB. <br>Non Heap Memory used 5.31 MB is 22% of  Commited Non Heap Memory 23.19 MB. Max Non Heap Memory is 130 MB.<br>
2021-08-23 13:38:29,139 WARN org.apache.hadoop.mapred.Child: Child starTing
2021-08-23 13:38:29,139 WARN org.apache.hadoop.mapred.Child: ################################ STARTattempt_20210622151530_18386445_m000_000001_3#############################################
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: LIST DIR :/home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/appSlave/job_20210622151530_18386445/attempt_20210622151530_18386445_m000_000001_3/work/.
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>META-INF
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>aBACi
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>.__NORMAndy_plat_meta_flag
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>tmp
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>mr_exec
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>org
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>aBACi_logs
2021-08-23 13:38:29,140 WARN org.apache.hadoop.mapred.Child: >>pids
2021-08-23 13:38:29,275 WARN org.apache.hadoop.mapred.Child: Enable UGI login method.
2021-08-23 13:38:29,497 INFO org.apache.hadoop.fs.LibdfsLoader: Trying to load the libdfs library...
2021-08-23 13:38:29,505 INFO org.apache.hadoop.fs.LibdfsLoader: Loaded the libdfs library
2021-08-23 13:38:29,505 INFO org.apache.hadoop.fs.DFileSystem: Loaded the libdfs library
2021-08-23 13:38:29,917 WARN org.apache.hadoop.mapred.NewLocalDirAllocator: contextCfgSataItemname = mapred.local.sata.dir
2021-08-23 13:38:29,927 INFO org.apache.hadoop.mapred.TaskLog: Re-init all TLA for jvm reuse: attempt_20210622151530_18386445_m000_000001_3
2021-08-23 13:38:29,944 INFO org.apache.hadoop.mapred.Child: open jobconf file /home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/appSlave/job_20210622151530_18386445/attempt_20210622151530_18386445_m000_000001_3/job.xml
2021-08-23 13:38:30,011 WARN org.apache.hadoop.mapred.Child: DAGJobConf CREATED, vertexId = 0
2021-08-23 13:38:30,012 WARN org.apache.hadoop.mapred.NewLocalDirAllocator: contextCfgSataItemname = mapred.local.sata.dir
2021-08-23 13:38:30,013 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=MAP, sessionId=
2021-08-23 13:38:30,097 WARN org.apache.hadoop.mapred.MapTask: checking local shuffleservice if ok or not!
2021-08-23 13:38:30,113 WARN org.apache.hadoop.mapred.MapTask: local shuffleservice is ok!
2021-08-23 13:38:30,121 WARN org.apache.hadoop.mapred.NewLocalDirAllocator: contextCfgSataItemname = mapred.local.sata.dir
2021-08-23 13:38:30,126 WARN com.baidu.inf.aBACi.perf.CPUMonitor: 34497 (java) S 33691 33291 33291 0 -1 1077960960 34042 449 0 0 180 14 0 0 20 0 22 0 1425577643 2027565056 24976 1887436800 1073741824 1073778376 140730717009680 140730717000848 270776954875 0 4 3 16800972 18446744073709551615 0 0 17 27 0 5 0 0 0 1074826952 1074830912 1087045632 140730717013749 140730717016938 140730717016938 140730717069075 0
2021-08-23 13:38:30,127 INFO com.baidu.inf.aBACi.perf.CPUMonitor: utime: 180
2021-08-23 13:38:30,127 INFO com.baidu.inf.aBACi.perf.CPUMonitor: stime: 14
2021-08-23 13:38:30,132 INFO org.apache.hadoop.mapred.MapTask: numPartitions: 10
2021-08-23 13:38:30,132 WARN org.apache.hadoop.mapred.MapTask: #######locolDirs=/home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk2/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk3/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk4/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk5/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk6/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name,/home/disk7/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name
2021-08-23 13:38:30,156 WARN org.apache.hadoop.mapred.hce.StreamingToHceUtil: Try to replace task to HCE..
2021-08-23 13:38:30,158 WARN org.apache.hadoop.mapred.hce.StreamingToHceUtil: input_type:SPLIT output_type:SHUFFLE
2021-08-23 13:38:30,180 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library
2021-08-23 13:38:30,182 INFO org.apache.hadoop.io.compress.LzoCodec: successfully loaded & initialized native-lzo library
2021-08-23 13:38:30,184 INFO org.apache.hadoop.io.compress.LzmaCodec: successfully loaded & initialized native-lzma library
2021-08-23 13:38:30,186 INFO org.apache.hadoop.io.compress.QuickLzCodec: successfully loaded & initialized native-quicklz library
2021-08-23 13:38:30,189 INFO org.apache.hadoop.io.compresS.Util.FourMcNativeCodeLoader: hadoop-4mc: loaded native library (lib-path)
2021-08-23 13:38:30,191 INFO org.apache.hadoop.io.compress.ZstdCodec: successfully loaded & initialized hadoop-4mc library
2021-08-23 13:38:30,193 INFO org.apache.hadoop.io.compress.ZstCodec: successfully loaded & initialized hadoop-4mc library
2021-08-23 13:38:30,193 INFO org.apache.hadoop.io.compress.FourMzCodec: successfully loaded & initialized hadoop-4mc library
2021-08-23 13:38:30,197 WARN org.apache.hadoop.mapred.hce.StreamingToHceUtil: replacE into Hce Task successfully!
2021-08-23 13:38:30,197 WARN org.apache.hadoop.mapred.NewLocalDirAllocator: contextCfgSataItemname = mapred.local.sata.dir
2021-08-23 13:38:30,200 INFO org.apache.hadoop.mapred.MapTask: MapTask used Hadoop C++ Extension.
2021-08-23 13:38:30,203 INFO org.apache.hadoop.mapred.MapTask: runner.run() start
2021-08-23 13:38:30,203 WARN com.baidu.inf.aBACi.perf.CPUMonitor: 34497 (java) S 33691 33291 33291 0 -1 1077960960 37578 449 0 0 194 15 0 0 20 0 22 0 1425577643 2035720192 26476 1887436800 1073741824 1073778376 140730717009680 140730717000848 270776954875 0 4 3 16800972 18446744073709551615 0 0 17 27 0 5 0 0 0 1074826952 1074830912 1087045632 140730717013749 140730717016938 140730717016938 140730717069075 0
2021-08-23 13:38:30,203 INFO com.baidu.inf.aBACi.perf.CPUMonitor: utime: 194
2021-08-23 13:38:30,204 INFO com.baidu.inf.aBACi.perf.CPUMonitor: stime: 15
2021-08-23 13:38:30,212 WARN org.apache.hadoop.mapred.hce.Application: random port :0
2021-08-23 13:38:30,234 INFO org.apache.hadoop.mapred.hce.Application: Hce MapRed exec: [/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhce/bin/StreamingProcess]
2021-08-23 13:38:30,239 INFO org.apache.hadoop.mapred.hce.Application: StreamingOverHCE Streaming exec: [/home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/appSlave/job_20210622151530_18386445/attempt_20210622151530_18386445_m000_000001_3/work/././mr_exec/mr_map, --conf_path=mr_exec/wordcount_mapper, --log_path=mr_exec]
2021-08-23 13:38:30,253 WARN org.apache.hadoop.mapred.hce.Application: start child as subprocess
2021-08-23 13:38:30,254 WARN org.apache.hadoop.mapred.hce.Application: aBACi.limit3.enable: false
2021-08-23 13:38:30,254 WARN org.apache.hadoop.mapred.hce.Application: hce.memory.limit.factor = 1.0
2021-08-23 13:38:30,254 WARN org.apache.hadoop.mapred.hce.Application: [/bin/limit3, -m, 2662400, export LD_LIBRARY_PATH=/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../../java6/jre/lib/amd64/server:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../../java6/jre/lib/amd64/native_threads:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../../java6/jre/lib/amd64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../lib/native/Linux-amd64-64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../fslibraries:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhce/lib:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64/server:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/../lib/amd64:/home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/appSlave/job_20210622151530_18386445/attempt_20210622151530_18386445_m000_000001_3/work:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64/server:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/../lib/amd64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../lib/native/Linux-amd64-64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhce/lib:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhdfs:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../../dce/so:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../lib/native/Linux-amd64-64:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64/server:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/../lib/amd64:/home/disk1/normAndy/local/20210823/10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/appSlave/job_20210622151530_18386445/attempt_20210622151530_18386445_m000_000001_3/work:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64/server:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/lib/amd64:/home/disk7/normAndy/cache/20210325/1743495697.hdfs.ARCHIVE.PWOGB.yq01-build-hdfs.dmop.baidu.com.54310.app.dc.deva.system.share.aBACi_3-31-4_PD_BL_20210325_jobmentor_dce-off_new_dce_hardlimit4.tar.gz/hadoop-v2/java6/jre/../lib/amd64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../lib/native/Linux-amd64-64:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhce/lib:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhdfs:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../../dce/so:/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../lib/native/Linux-amd64-64 ; exec '/bin/sh' '-c' '/home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/aBACi/hadoop-v2/hadoop/bin/../libhce/bin/StreamingProcess ' ]
2021-08-23 13:38:30,255 INFO org.apache.hadoop.mapred.hce.Application: before runClient(), home path:/home/normAndy
2021-08-23 13:38:30,343 WARN com.baidu.inf.aBACi.perf.CPUMonitor: logDir : /home/disk6/normAndy/work/20210823/newlocal.1629697081.10.yqbuild-job_20210622151530_18386445-appslave--job_20210622151530_18386445-vertex0-map.unknown_name/./logs/attempt_20210622151530_18386445_m000_000001_3
2021-08-23 13:38:30,359 WARN org.apache.hadoop.mapred.hce.Application: create  Monitor Thread
2021-08-23 13:38:30,361 WARN org.apache.hadoop.mapred.hce.Application: Monitor Thread has started
2021-08-23 13:38:30,362 INFO org.apache.hadoop.mapred.hce.Application: before startOutputThreads
2021-08-23 13:38:30,364 INFO org.apache.hadoop.mapred.hce.Application: before serverSocket.accept()
2021-08-23 13:38:30,960 INFO org.apache.hadoop.mapred.hce.Application: before downlink.start()
2021-08-23 13:38:30,970 INFO org.apache.hadoop.mapred.hce.binaryProtocol: starTing downlink
2021-08-23 13:38:30,970 INFO org.apache.hadoop.mapred.hce.Application: before downlink.setJobConf()
2021-08-23 13:38:30,996 INFO org.apache.hadoop.mapred.hce.binaryProtocol: runMap(), inputSplit: afs://baihua.afs.baidu.com:9902/user/sasd-score/diaoyan/liuweiwei/wordcount/input/word1.txt:0+28
2021-08-23 13:38:30,996 INFO org.apache.hadoop.mapred.hce.Application: before wait for commit
2021-08-23 13:38:33,001 INFO org.apache.hadoop.mapred.hce.binaryProtocol: Hce child fail
2021-08-23 13:38:33,002 ERROR 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

大佬总结

以上是大佬教程为你收集整理的syslog全部内容,希望文章能够帮你解决syslog所遇到的程序开发问题。

如果觉得大佬教程网站内容还不错,欢迎将大佬教程推荐给程序员好友。

本图文内容来源于网友网络收集整理提供,作为学习参考使用,版权属于原作者。
如您有任何意见或建议可联系处理。小编QQ:384754419,请注明来意。