关于网友提出的“ Sqoop1995从mysql导入到hdfs出错！Job Failed with status:3”问题疑问，本网通过在网上对“ Sqoop1995从mysql导入到hdfs出错！Job Failed with status:3”有关的相关答案进行了整理，供用户进行参考，详细问题解答如下：
问题： Sqoop1995从mysql导入到hdfs出错！Job Failed with status:3描述:
本帖最后由 BIackGlede 于 2015-05-08 16:10:09 编辑
sqoop
环境是hadoop2.6，集群中有四个节点，运行正常。Sqoop2 job配置：
Job with id 1 and name Sqoopy (Enabled: true, Created by root at 5/7/15 5:26 PM, Updated by root at 5/7/15 5:26 PM)
Using link id 2 and Connector id 1
From database configuration
Schema name: rural_biz
Table name: RefundOrder
Table SQL statement:
Table column names:
Partition column name:
Null value allowed for the partition column:
Boundary query:
Throttling resources
Extractors: 2
Loaders: 2
ToJob configuration
Override null value:
Null value:
Output format: TEXT_FILE
Compression format: NONE
Custom compression format:
Output directory: /
Sqoop2 job运行状态：
2015-05-08 14:29:12 CST: RUNNING - 84.47 %
2015-05-08 14:29:22 CST: RUNNING - 84.47 %
2015-05-08 14:29:32 CST: RUNNING - 84.47 %
2015-05-08 14:29:42 CST: RUNNING - 84.47 %
2015-05-08 14:29:52 CST: RUNNING - 84.47 %
2015-05-08 14:30:02 CST: RUNNING - 84.47 %
2015-05-08 14:30:13 CST: RUNNING - 84.47 %
2015-05-08 14:30:23 CST: RUNNING - 84.47 %
2015-05-08 14:30:33 CST: RUNNING - 84.47 %
2015-05-08 14:30:43 CST: RUNNING - 84.47 %
2015-05-08 14:30:53 CST: RUNNING - 84.47 %
2015-05-08 14:31:04 CST: RUNNING - 84.47 %
2015-05-08 14:31:14 CST: RUNNING - 84.47 %
2015-05-08 14:31:24 CST: RUNNING - 84.47 %
2015-05-08 14:31:34 CST: RUNNING - 84.47 %
2015-05-08 14:31:44 CST: RUNNING - 84.47 %
2015-05-08 14:31:54 CST: RUNNING - 84.47 %
2015-05-08 14:32:04 CST: RUNNING - 84.47 %
2015-05-08 14:32:14 CST: RUNNING - 100.00 %
2015-05-08 14:32:47 CST: FAILED
Exception: Job Failed with status:3
查看Reduce Tack发现reduce一直卡在哪儿但又不会报错。yarn的运行日志没有任何问题。
sqoop.log一直显示
[org.apache.sqoop.security.Authorization.DefaultAuthorizationValidator.checkPrivileges(DefaultAuthorizationValidator.java:39)] privilege: Privilege (Privilege resource: Resource (Resource name: 1, Resource type: JOB ), Privilege action: STATUS, Privilege with_grant_option: false )
2015-05-08 14:49:16,279 INFO default [org.apache.sqoop.audit.FileAuditLogger.logAuditEvent(FileAuditLogger.java:86)] user=root ip=127.0.0.1 op=status obj=job objId=1
2015-05-08 14:49:16,292 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2015-05-08 14:49:16,677 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2015-05-08 14:49:16,677 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2015-05-08 14:49:16,677 INFO repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2015-05-08 14:51:08,954 DEBUG driver.JobManager [org.apache.sqoop.driver.JobManager$UpdateThread.run(JobManager.java:670)] Updating running submissions
2015-05-08 14:51:08,993 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2015-05-08 14:51:08,994 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2015-05-08 14:51:08,994 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2015-05-08 14:51:08,994 INFO repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2015-05-08 14:56:08,995 DEBUG driver.JobManager [org.apache.sqoop.driver.JobManager$UpdateThread.run(JobManager.java:670)] Updating running submissions
2015-05-08 14:56:09,051 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2015-05-08 14:56:09,052 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2015-05-08 14:56:09,061 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2015-05-08 14:56:09,061 INFO repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2015-05-08 15:01:09,102 DEBUG driver.JobManager [org.apache.sqoop.driver.JobManager$UpdateThread.run(JobManager.java:670)] Updating running submissions
2015-05-08 15:01:09,654 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2015-05-08 15:01:09,655 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2015-05-08 15:01:09,655 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2015-05-08 15:01:09,656 INFO repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
也没有明显的出错信息。
在从节点的job日志中有失败信息显示：
2015-05-08 13:59:29,274 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP
2015-05-08 13:59:29,274 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1430983821763_0004_r_000001_0: AttemptID:attempt_1430983821763_0004_r_000001_0 Timed out after 600 secs
2015-05-08 13:59:29,275 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000001_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP
015-05-08 13:59:29,304 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-05-08 13:59:29,305 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1430983821763_0004_r_000001_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
来个人帮榜忙阿！！