首页
学习
活动
专区
圈层
工具
发布
首页
学习
活动
专区
圈层
工具
MCP广场
社区首页 >问答首页 >Prediction.io训练无响应

Prediction.io训练无响应
EN

Stack Overflow用户
提问于 2016-06-11 18:53:03
回答 1查看 213关注 0票数 0

我使用的是prediction.ioSimilarProduct模板,插入了16,000个产品,70,000个用户和160万个观看事件。

pio build已成功完成,但在pio train中,它在第13阶段没有响应,因为我已经尝试了3次,等待了6到7个小时,但它停留在第13阶段,下面是日志

代码语言:javascript
运行
复制
[INFO] [Console$] Using existing engine manifest JSON at /home/dau/PredictionIO/similar_product/manifest.json
[INFO] [Runner$] Submission command: /home/dau/PredictionIO/vendors/spark-1.6.0/bin/spark-submit --class io.prediction.workflow.CreateWorkflow --jars file:/home/dau/PredictionIO/similar_product/target/scala-2.10/template-scala-parallel-similarproduct-assembly-0.1-SNAPSHOT-deps.jar,file:/home/dau/PredictionIO/similar_product/target/scala-2.10/template-scala-parallel-similarproduct_2.10-0.1-SNAPSHOT.jar --files file:/home/dau/PredictionIO/conf/log4j.properties,file:/home/dau/PredictionIO/vendors/hbase-1.1.2/conf/hbase-site.xml --driver-class-path /home/dau/PredictionIO/conf:/home/dau/PredictionIO/lib/postgresql-9.4-1204.jdbc41.jar:/home/dau/PredictionIO/lib/mysql-connector-java-5.1.37.jar:/home/dau/PredictionIO/vendors/hbase-1.1.2/conf file:/home/dau/PredictionIO/lib/pio-assembly-0.9.6.jar --engine-id TvPK9sthW8Hjh6lyz0PRqtCb6IIzOLSF --engine-version 9c974b7a0cc9a0a9c97387bbacb6486db3ebb738 --engine-variant file:/home/dau/PredictionIO/similar_product/engine.json --verbosity 0 --json-extractor Both --env PIO_STORAGE_SOURCES_HBASE_TYPE=hbase,PIO_ENV_LOADED=1,PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta,PIO_FS_BASEDIR=/home/dau/.pio_store,PIO_STORAGE_SOURCES_HBASE_HOME=/home/dau/PredictionIO/vendors/hbase-1.1.2,PIO_HOME=/home/dau/PredictionIO,PIO_FS_ENGINESDIR=/home/dau/.pio_store/engines,PIO_STORAGE_SOURCES_LOCALFS_PATH=/home/dau/.pio_store/models,PIO_STORAGE_SOURCES_ELASTICSEARCH_TYPE=elasticsearch,PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=ELASTICSEARCH,PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=LOCALFS,PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event,PIO_STORAGE_SOURCES_ELASTICSEARCH_HOME=/home/dau/PredictionIO/vendors/elasticsearch-1.7.3,PIO_FS_TMPDIR=/home/dau/.pio_store/tmp,PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model,PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=HBASE,PIO_CONF_DIR=/home/dau/PredictionIO/conf,PIO_STORAGE_SOURCES_LOCALFS_TYPE=localfs
[INFO] [Engine] Extracting datasource params...
[INFO] [WorkflowUtils$] No 'name' is found. Default empty String will be used.
[INFO] [Engine] Datasource params: (,DataSourceParams(rw_store))
[INFO] [Engine] Extracting preparator params...
[INFO] [Engine] Preparator params: (,Empty)
[INFO] [Engine] Extracting serving params...
[INFO] [Engine] Serving params: (,Empty)
[WARN] [Utils] Your hostname, dau-lap resolves to a loopback address: 127.0.1.1; using 192.168.43.91 instead (on interface wlan0)
[WARN] [Utils] Set SPARK_LOCAL_IP if you need to bind to another address
[INFO] [Remoting] Starting remoting
[INFO] [Remoting] Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@192.168.43.91:40349]
[INFO] [Engine$] EngineWorkflow.train
[INFO] [Engine$] DataSource: com.company.DataSource@7cfb8e98
[INFO] [Engine$] Preparator: com.company.Preparator@1ec88aa1
[INFO] [Engine$] AlgorithmList: List(com.company.ALSAlgorithm@3030836d)
[INFO] [Engine$] Data sanity check is on.
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[INFO] [Engine$] com.company.TrainingData does not support data sanity check. Skipping check.
[INFO] [Engine$] com.company.PreparedData does not support data sanity check. Skipping check.
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[WARN] [TableInputFormatBase] Cannot resolve the host name for dau-lap/127.0.1.1 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '1.1.0.127.in-addr.arpa'
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.    
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 0 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 3055 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 3055 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 3055 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 222 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 222 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 416 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 0 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[Stage 13:>                                                         (0 + 1) / 2][INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 0 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 484 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 222 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 414 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[INFO] [ALSAlgorithm] Couldn't convert nonexistent item ID 513 to Int index.
[Stage 13:=============================>                            (1 + 0) / 2]

这是engine.json

代码语言:javascript
运行
复制
{
  "id": "default",
  "description": "Default settings",
  "engineFactory": "com.company.SimilarProductEngine",
  "datasource": {
    "params" : {
      "appName": "store"
    }
  },
  "algorithms": [
    {
      "name": "als",
      "params": {
        "rank": 10,
        "numIterations" : 20,
        "lambda": 0.01,
        "seed": 3
      }
    }
  ]
}
EN

回答 1

Stack Overflow用户

发布于 2018-12-11 21:52:37

你应该定义三种类型的events.user,item和view Event.我认为你在没有相应item的特定项目上定义view event。

票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/37762879

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档