-- Logs begin at Mon 2021-01-25 11:39:26 UTC, end at Mon 2021-01-25 15:00:00 UTC. --
Jan 25 12:31:39.970453 n-d-760454-3 systemd[1]: Started Devstack devstack@c-vol.service.
Jan 25 12:31:42.974406 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89138) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}}
Jan 25 12:31:42.974937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89138) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}}
Jan 25 12:31:43.769467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89138) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:31:43.958648 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Automatically selected cinder-scheduler objects version 1.38 as minimum service version.
Jan 25 12:31:43.964492 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jan 25 12:31:44.003131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89138) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:31:44.039381 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Determined volume DB was empty at startup.
Jan 25 12:31:44.041612 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89138) __init__ /opt/stack/cinder/cinder/volume/manager.py:235}}
Jan 25 12:31:44.047700 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jan 25 12:31:44.048571 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:31:44.053450 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:31:44.053450 n-d-760454-3 cinder-volume[89138]: WARNING cinder.keymgr.conf_key_mgr [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:31:44.064443 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.tgt.TgtAdm {{(pid=89138) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:105}}
Jan 25 12:31:44.075451 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Image-volume cache disabled for host n-d-760454-3@lvmdriver-1.
Jan 25 12:31:44.084230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89138) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:31:44.130355 n-d-760454-3 cinder-volume[89138]: INFO oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Starting 1 workers
Jan 25 12:31:44.135797 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Started child 89244 {{(pid=89138) _start_child /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:576}}
Jan 25 12:31:44.136938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Full set of CONF: {{(pid=89138) wait /usr/local/lib/python3.6/dist-packages/oslo_service/service.py:650}}
Jan 25 12:31:44.137351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] ******************************************************************************** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}}
Jan 25 12:31:44.137704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] Configuration options gathered from: {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}}
Jan 25 12:31:44.138106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}}
Jan 25 12:31:44.138789 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}}
Jan 25 12:31:44.139155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] ================================================================================ {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}}
Jan 25 12:31:44.139994 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] allow_availability_zone_fallback = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.140397 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] allow_compression_on_image_upload = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.140687 n-d-760454-3 cinder-volume[89138]: INFO cinder.service [-] Starting cinder-volume node (version 17.1.0)
Jan 25 12:31:44.141060 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] allowed_direct_url_schemes     = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.141501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] api_rate_limit                 = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.141993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] auth_strategy                  = keystone {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.142438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_availability_zone      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.142867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_host                   = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.143267 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_name                   = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.143747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_stats_polling_interval = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.144212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backup_api_class               = cinder.backup.api.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.144666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.145116 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backup_name_template           = backup-%s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.145561 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backup_use_same_host           = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.145978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backup_use_temp_snapshot       = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.146412 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] chap_password                  = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.146853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] chap_username                  =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.147306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.147795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_internal_tenant_project_id = 12da214c4ca347e39b53fc42995d6a36 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.148255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_internal_tenant_user_id = 2579b665657f4254bd4cfbd4c5006205 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.148706 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cluster                        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.149140 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] compression_format             = gzip {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.149602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.150590 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] config_dir                     = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.150919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.151391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] config_source                  = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.151813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.152275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] control_exchange               = openstack {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.152645 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] db_driver                      = cinder.db {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.153097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] debug                          = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.153493 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] default_availability_zone      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.153891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] default_group_type             = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.154571 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.155020 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] default_volume_type            = lvmdriver-1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.155420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_client_cert             = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.155847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_client_cert_key         = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.156244 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_data_namespace          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.156671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_ssl_cert_path           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.157074 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_ssl_cert_verify         = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.157496 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] driver_use_ssl                 = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.157863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enable_new_services            = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.158277 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enable_unsupported_driver      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.158676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enable_v2_api                  = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.159084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enable_v3_api                  = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.159575 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.159985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] enforce_multipath_for_image_xfer = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.160380 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] filter_function                = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.160805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_api_insecure            = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.161242 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_api_servers             = ['http://10.222.0.65/image'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.161642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_api_ssl_compression     = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.162035 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_ca_certificates_file    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.162472 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.163090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.163501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_num_retries             = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.163898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] glance_request_timeout         = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.164293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] goodness_function              = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.164754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] graceful_shutdown_timeout      = 5 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.165179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] group_api_class                = cinder.group.api.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.166481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] host                           = n-d-760454-3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.166955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.167392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_compress_on_upload       = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.167808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_conversion_address_space_limit = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.168208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_conversion_cpu_limit     = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.169542 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.169956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_upload_use_cinder_backend = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.170379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_upload_use_internal_tenant = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.170782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_volume_cache_enabled     = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.171193 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_volume_cache_max_count   = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.171598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.172039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] init_host_max_objects_retrieval = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.172462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.172910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.173363 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iscsi_iotype                   = fileio {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.173789 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iscsi_secondary_ip_addresses   = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.174203 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iscsi_target_flags             =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.174638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iscsi_write_cache              = on {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.174871 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jan 25 12:31:44.175043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iser_helper                    = tgtadm {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.175780 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iser_ip_address                = 10.222.0.65 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.176229 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iser_port                      = 3260 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.176675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.177137 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_config_append              = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.177238 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:44.177503 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.177920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_dir                        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.178320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_file                       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.178661 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_options                    = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.179077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_rotate_interval            = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.179514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_rotate_interval_type       = days {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.179934 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] log_rotation_type              = none {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.180283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.180662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.181137 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.181582 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.181924 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.182357 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] max_age                        = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.182760 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] max_logfile_count              = 30 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.183161 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] max_logfile_size_mb            = 200 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.183608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] max_over_subscription_ratio    = 20.0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.184056 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] message_reap_interval          = 86400 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.184485 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] message_ttl                    = 2592000 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.184940 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.185517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] monkey_patch                   = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.185933 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] monkey_patch_modules           = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.186273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] my_ip                          = 10.222.0.65 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.186673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] no_snapshot_gb_quota           = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.187075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] num_iser_scan_tries            = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.187517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] num_shell_tries                = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.187941 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] num_volume_device_scan_tries   = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.188342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] nvmet_ns_id                    = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.188792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] nvmet_port_id                  = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.189226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_max_limit                = 1000 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.189650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_ext_list          = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.190127 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.190566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.190984 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_listen_port       = 8776 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.191388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_use_ssl           = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.191809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] osapi_volume_workers           = 2 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.192227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] per_volume_size_limit          = -1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.192660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] periodic_fuzzy_delay           = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.193075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] periodic_interval              = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.193471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] public_endpoint                = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.193866 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] publish_errors                 = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.194305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_backup_gigabytes         = 1000 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.194719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_backups                  = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.195117 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_consistencygroups        = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.195557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.195979 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_gigabytes                = 1000 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.196419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_groups                   = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.196907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_snapshots                = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.197340 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] quota_volumes                  = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.197751 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] rate_limit_burst               = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.198171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] rate_limit_except_level        = CRITICAL {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.198317 n-d-760454-3 sudo[89245]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
Jan 25 12:31:44.198755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] rate_limit_interval            = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.198844 n-d-760454-3 sudo[89245]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:44.199377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] reinit_driver_count            = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.199377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] replication_device             = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.199726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] report_discard_supported       = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.200148 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] report_interval                = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.200709 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] reservation_clean_interval     = 86400 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.201050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] reservation_expire             = 86400 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.201490 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] reserved_percentage            = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.201923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.202258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.202718 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] rpc_response_timeout           = 120 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.203114 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] run_external_periodic_tasks    = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.203549 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.203974 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] scst_target_driver             = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.204362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] scst_target_iqn_name           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.204725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_down_time              = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.205146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] snapshot_name_template         = snapshot-%s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.205544 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] split_loggers                  = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.205896 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] state_path                     = /opt/stack/data/cinder {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.206692 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] storage_availability_zone      = nova {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.207119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] storage_protocol               = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.207537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] syslog_log_facility            = LOG_USER {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.207976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] target_helper                  = tgtadm {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.208527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] target_ip_address              = 10.222.0.65 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.208954 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] target_port                    = 3260 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.209375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.209796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] target_protocol                = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.210187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] trace_flags                    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.210604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.211025 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] transport_url                  = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.211436 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] until_refresh                  = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.211839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_chap_auth                  = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.212883 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_default_quota_class        = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.213179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_eventlog                   = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.213592 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_journal                    = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.213988 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_json                       = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.214391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_multipath_for_image_xfer   = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.214802 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_stderr                     = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.215203 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] use_syslog                     = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.215646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] verify_glance_signatures       = enabled {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.216067 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_api_class               = cinder.volume.api.API {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.216458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_backend_name            = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.216929 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_clear                   = zero {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.217320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_clear_ionice            = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.217730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_clear_size              = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.218155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.218553 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_copy_bps_limit          = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.218966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_dd_blocksize            = 1M {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.219380 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.219797 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_name_template           = volume-%s {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.220224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_service_inithost_offload = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.220682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volume_usage_audit_period      = month {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.221207 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.221874 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] watch_log_file                 = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.222287 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] zoning_mode                    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}}
Jan 25 12:31:44.222788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.223248 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.enforce_new_defaults = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.223650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.enforce_scope      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.224099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.policy_default_rule = default {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.224563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.224995 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.225447 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.225849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.226265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.226661 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.227062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.227530 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.228043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.229069 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] privsep_osbrick.capabilities   = [21] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.229493 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] privsep_osbrick.group          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.229898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] privsep_osbrick.helper_command = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.230304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.230721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] privsep_osbrick.user           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.231222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.backend               = sqlalchemy {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.231586 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.connection            = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.232039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.connection_debug      = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.232458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.connection_parameters =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.232927 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.connection_recycle_time = 3600 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.233341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.connection_trace      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.233744 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.db_inc_retry_interval = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.234152 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.db_max_retries        = 20 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.234556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.db_max_retry_interval = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.234963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.db_retry_interval     = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.235378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.max_overflow          = 50 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.235800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.max_pool_size         = 5 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.236221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.max_retries           = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.236647 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.mysql_enable_ndb      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.237083 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.237491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.pool_timeout          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.237913 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.retry_interval        = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.238335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.slave_connection      = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.238777 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.sqlite_synchronous    = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.239126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] database.use_db_reconnect      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.239594 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.connection_string     = messaging:// {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.239960 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.enabled               = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.240375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.es_doc_type           = notification {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.240809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.es_scroll_size        = 10000 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.241239 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.es_scroll_time        = 2m {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.241647 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.filter_error_trace    = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.242085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.242495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.sentinel_service_name = mymaster {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.242977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.socket_timeout        = 0.1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.243379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] profiler.trace_sqlalchemy      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.243860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] coordination.backend_url       = etcd3+http://10.222.0.65:2379 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.244289 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.244715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_sys_admin.group         = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.245113 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_sys_admin.helper_command = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.245533 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.245931 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cinder_sys_admin.user          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.246366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.auth_section      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.246771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.auth_type         = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.247182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.cafile            = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.247578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.certfile          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.247990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.collect_timing    = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.248396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.insecure          = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.248820 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.keyfile           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.249234 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.send_service_user_token = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.249636 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.split_loggers     = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.250031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] service_user.timeout           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.250525 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.admin_password = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.250952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.251366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.admin_token = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.251770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.admin_user  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.252209 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.252656 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.253078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_port   = 35357 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.253526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_protocol = https {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.253970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_section = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.254394 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_type   = password {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.254818 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_uri    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.255214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.auth_version = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.255615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.cache       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.256050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.256566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.certfile    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.256985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.257423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.identity_uri = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.insecure    = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.264470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.interface   = public {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.keyfile     = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.region_name = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.265662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.service_type = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266558 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.backend                  = dogpile.cache.null {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.266993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.backend_argument         = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.267437 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.config_prefix            = cache.oslo {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.267858 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.debug_cache_backend      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.268833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.enabled                  = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.269472 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.expiration_time          = 600 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.269778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_dead_retry      = 300 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.270213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.270896 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.271021 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.271458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.272023 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.272443 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.proxies                  = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.272881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.tls_allowed_ciphers      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.273281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.tls_cafile               = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.273686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.tls_certfile             = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.274094 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.tls_enabled              = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.274493 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] cache.tls_keyfile              = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.275498 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.backend_availability_zone = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.275914 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.276330 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.276804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.chap_password = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.277208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.chap_username =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.277805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.278796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_client_cert = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.278796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.278983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_data_namespace = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.279368 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.280199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.280199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.driver_use_ssl = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.280855 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.281255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.281597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.extra_capabilities = {} {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.281993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.filter_function = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.282388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.goodness_function = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.282805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.283206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.283607 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.284002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.284401 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.284856 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.285315 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.285685 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.286102 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iscsi_target_flags =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.286515 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.286946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.288085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iser_ip_address = 10.222.0.65 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.288085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iser_port     = 3260 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.288402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.288851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.289261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.lvm_type      = auto {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.296634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.replication_device = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.report_discard_supported = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.storage_protocol = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.target_helper = tgtadm {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.target_ip_address = 10.222.0.65 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.target_port   = 3260 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.297755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.298296 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.target_protocol = iscsi {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.298296 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.trace_flags   = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.298478 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.298851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.use_chap_auth = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.299241 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.299635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_backend_name = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.300050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_clear  = zero {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.300439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.300860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.301279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.301682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.302183 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.302607 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.303020 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.303361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.303806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_reports.file_event_handler = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.304209 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.304640 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_reports.log_dir           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.305008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.305411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.backend_host       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.305808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.306276 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.306676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.chap_password      = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.307063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.chap_username      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.307474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.307868 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_client_cert = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.308627 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.308627 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.309021 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.309392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.309786 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.310191 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.310591 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.310926 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.extra_capabilities = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.311312 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.filter_function    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.312249 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.goodness_function  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.312249 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iet_conf           = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.312446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.312842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.313176 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.image_volume_cache_enabled = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.313629 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.314009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.314382 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.314937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iscsi_secondary_ip_addresses = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.315496 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.316057 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.316453 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iser_helper        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.316869 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.317269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iser_port          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.317651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.318038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.318428 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.318800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.319221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.lvm_type           = default {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.319611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.320003 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.320407 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.320843 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.321269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.321692 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.322197 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.replication_device = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.322639 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.report_discard_supported = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.323085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.reserved_percentage = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.323477 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.scst_target_driver = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.324014 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.324411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.storage_protocol   = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.324833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.325171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.target_helper      = tgtadm {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.325578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.target_ip_address  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.325967 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.target_port        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.326300 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.target_prefix      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.326717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.target_protocol    = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.327109 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.trace_flags        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.327501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.327898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.328287 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.328651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.329066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_clear       = none {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.330064 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.330064 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.330388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.330537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.330919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.331344 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.331754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.332560 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] lvmdriver-1.volumes_dir        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.332751 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.332992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.333431 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.334257 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.334257 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.334582 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.334993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.335829 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.335829 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.336108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.336596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.336933 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.337892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.338293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.338694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.339156 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.339551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.339955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.340345 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.340891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.341174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.341602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.342000 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.342578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.343151 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.343596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.344061 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_notifications.driver = [] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.344438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.345075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.345495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.345970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.346678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] key_manager.fixed_key          = **** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.347180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.347597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.barbican_api_version  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.347990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.barbican_endpoint     = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.348430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.barbican_endpoint_type = public {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.348861 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.cafile                = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.349275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.certfile              = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.349672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.collect_timing        = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.350068 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.insecure              = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.350455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.keyfile               = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.350851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.number_of_retries     = 60 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.351246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.retry_delay           = 1 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.352126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.split_loggers         = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.352126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.timeout               = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.352391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.verify_ssl            = True {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.352804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] barbican.verify_ssl_path       = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.353778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.approle_role_id          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.354191 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.approle_secret_id        = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.354580 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.cafile                   = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.354968 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.certfile                 = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.355366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.collect_timing           = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.356410 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.insecure                 = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.356410 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.keyfile                  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.356626 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.kv_mountpoint            = secret {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.356916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.kv_version               = 2 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.357788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.root_token_id            = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.357788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.split_loggers            = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.358039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.ssl_ca_crt_file          = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.358426 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.timeout                  = None {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.358817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.use_ssl                  = False {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.359757 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}}
Jan 25 12:31:44.359757 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.service [None req-3dd5fe1d-eb10-4855-bb2c-cff07c43c6a1 None None] ******************************************************************************** {{(pid=89138) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}}
Jan 25 12:31:44.575000 n-d-760454-3 sudo[89245]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:44.577084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version" returned: 0 in 0.400s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:44.578691 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:44.591495 n-d-760454-3 sudo[89451]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
Jan 25 12:31:44.591998 n-d-760454-3 sudo[89451]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:44.935914 n-d-760454-3 sudo[89451]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:44.938193 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version" returned: 0 in 0.359s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:44.939269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:44.952210 n-d-760454-3 sudo[89624]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jan 25 12:31:44.952807 n-d-760454-3 sudo[89624]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:45.318082 n-d-760454-3 sudo[89624]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:45.320063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.381s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:45.321143 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:45.333759 n-d-760454-3 sudo[89690]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
Jan 25 12:31:45.334280 n-d-760454-3 sudo[89690]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:45.683655 n-d-760454-3 sudo[89690]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:45.685863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version" returned: 0 in 0.364s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:45.687748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:45.704563 n-d-760454-3 sudo[89775]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jan 25 12:31:45.705583 n-d-760454-3 sudo[89775]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:46.231152 n-d-760454-3 sudo[89775]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:46.233236 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.545s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:46.234578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:46.248161 n-d-760454-3 sudo[89786]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:31:46.248706 n-d-760454-3 sudo[89786]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:46.618398 n-d-760454-3 sudo[89786]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:46.620392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:46.621160 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:31:46.622227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:46.635974 n-d-760454-3 sudo[89792]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:31:46.636802 n-d-760454-3 sudo[89792]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:47.021412 n-d-760454-3 sudo[89792]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:47.023419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:47.025089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:47.038137 n-d-760454-3 sudo[89796]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:31:47.038737 n-d-760454-3 sudo[89796]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:47.541084 n-d-760454-3 sudo[89796]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:47.543426 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:47.545488 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.driver [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Driver hasn't implemented _init_vendor_properties()
Jan 25 12:31:47.546052 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 48.82, 'free_capacity_gb': 48.82, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:n-d-760454-3:stack-volumes-lvmdriver-1:default:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': False, 'thick_provisioning_support': True, 'total_volumes': 0, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89244) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}}
Jan 25 12:31:47.568434 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:31:47.588627 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.db.sqlalchemy.api [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Building query based on filter {{(pid=89244) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3106}}
Jan 25 12:31:47.604092 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89244) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:884}}
Jan 25 12:31:47.611982 n-d-760454-3 cinder-volume[89138]: INFO cinder.keymgr.migration [None req-9a5a2b30-074f-4fe8-b6e3-26b6866dc4e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jan 25 12:31:47.615131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:31:47.615934 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:47.630522 n-d-760454-3 sudo[89800]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:31:47.631070 n-d-760454-3 sudo[89800]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:48.013844 n-d-760454-3 sudo[89800]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:48.016099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:48.017982 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:48.032298 n-d-760454-3 sudo[89810]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:31:48.032842 n-d-760454-3 sudo[89810]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:48.618203 n-d-760454-3 sudo[89810]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:48.621107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:48.623119 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:31:48.655322 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Driver initialization completed successfully.
Jan 25 12:31:48.664596 n-d-760454-3 cinder-volume[89138]: INFO cinder.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Initiating service 3 cleanup
Jan 25 12:31:48.670688 n-d-760454-3 cinder-volume[89138]: INFO cinder.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Service 3 cleanup completed.
Jan 25 12:31:48.671200 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.service [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Creating RPC server for service cinder-volume {{(pid=89244) start /opt/stack/cinder/cinder/service.py:231}}
Jan 25 12:31:48.678527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.service [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Pinning object versions for RPC server serializer to 1.38 {{(pid=89244) start /opt/stack/cinder/cinder/service.py:238}}
Jan 25 12:31:48.753895 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jan 25 12:31:48.754352 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:31:48.755120 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:48.769467 n-d-760454-3 sudo[89815]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:31:48.770194 n-d-760454-3 sudo[89815]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:49.157554 n-d-760454-3 sudo[89815]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:49.159464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:49.161283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:31:49.175157 n-d-760454-3 sudo[89819]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:31:49.175859 n-d-760454-3 sudo[89819]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:31:49.701832 n-d-760454-3 sudo[89819]: pam_unix(sudo:session): session closed for user root
Jan 25 12:31:49.704037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:31:49.750758 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-050a42ed-b9f2-4c76-9f69-0bd9ecc5929d None None] Driver post RPC initialization completed successfully.
Jan 25 12:33:35.757131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:33:35.757708 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:33:35.758303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:33:35.771847 n-d-760454-3 sudo[92042]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:33:35.772423 n-d-760454-3 sudo[92042]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:33:36.146825 n-d-760454-3 sudo[92042]: pam_unix(sudo:session): session closed for user root
Jan 25 12:33:36.149923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.391s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:33:36.151754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:33:36.166172 n-d-760454-3 sudo[92048]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:33:36.166874 n-d-760454-3 sudo[92048]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:33:36.747871 n-d-760454-3 sudo[92048]: pam_unix(sudo:session): session closed for user root
Jan 25 12:33:36.749990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:33:36.750987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:34:35.761346 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:34:35.761879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:34:35.762513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:34:35.776501 n-d-760454-3 sudo[94592]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:34:35.777073 n-d-760454-3 sudo[94592]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:34:36.159481 n-d-760454-3 sudo[94592]: pam_unix(sudo:session): session closed for user root
Jan 25 12:34:36.161556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.399s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:34:36.162859 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:34:36.176337 n-d-760454-3 sudo[94596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:34:36.176997 n-d-760454-3 sudo[94596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:34:36.735142 n-d-760454-3 sudo[94596]: pam_unix(sudo:session): session closed for user root
Jan 25 12:34:36.737501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:34:36.738410 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:35:35.767435 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:35:35.768044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:35:35.768631 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:35:35.783474 n-d-760454-3 sudo[94861]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:35:35.784013 n-d-760454-3 sudo[94861]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:35:36.178845 n-d-760454-3 sudo[94861]: pam_unix(sudo:session): session closed for user root
Jan 25 12:35:36.181095 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:35:36.182284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:35:36.197370 n-d-760454-3 sudo[94870]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:35:36.197939 n-d-760454-3 sudo[94870]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:35:36.809795 n-d-760454-3 sudo[94870]: pam_unix(sudo:session): session closed for user root
Jan 25 12:35:36.812084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:35:36.812978 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:36:35.772390 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:36:35.773083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:36:35.773646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:36:35.788116 n-d-760454-3 sudo[95128]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:36:35.788689 n-d-760454-3 sudo[95128]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:36:36.167145 n-d-760454-3 sudo[95128]: pam_unix(sudo:session): session closed for user root
Jan 25 12:36:36.169314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:36:36.170539 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:36:36.184665 n-d-760454-3 sudo[95132]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:36:36.185259 n-d-760454-3 sudo[95132]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:36:36.718227 n-d-760454-3 sudo[95132]: pam_unix(sudo:session): session closed for user root
Jan 25 12:36:36.720339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:36:36.721220 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:37:35.779379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:37:35.780002 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:37:35.780588 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:37:35.794015 n-d-760454-3 sudo[95296]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:37:35.794585 n-d-760454-3 sudo[95296]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:37:36.180152 n-d-760454-3 sudo[95296]: pam_unix(sudo:session): session closed for user root
Jan 25 12:37:36.182862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:37:36.184093 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:37:36.197888 n-d-760454-3 sudo[95300]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:37:36.198500 n-d-760454-3 sudo[95300]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:37:36.732623 n-d-760454-3 sudo[95300]: pam_unix(sudo:session): session closed for user root
Jan 25 12:37:36.734800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:37:36.735614 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:38:35.784659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:38:35.785267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:38:35.785902 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:38:35.799575 n-d-760454-3 sudo[95319]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:38:35.800291 n-d-760454-3 sudo[95319]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:38:36.183815 n-d-760454-3 sudo[95319]: pam_unix(sudo:session): session closed for user root
Jan 25 12:38:36.185951 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:38:36.187252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:38:36.200867 n-d-760454-3 sudo[95323]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:38:36.201411 n-d-760454-3 sudo[95323]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:38:36.760168 n-d-760454-3 sudo[95323]: pam_unix(sudo:session): session closed for user root
Jan 25 12:38:36.762304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:38:36.763125 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:39:35.791504 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:39:35.792137 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:39:35.792711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:39:35.807007 n-d-760454-3 sudo[95352]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:39:35.807535 n-d-760454-3 sudo[95352]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:39:36.177242 n-d-760454-3 sudo[95352]: pam_unix(sudo:session): session closed for user root
Jan 25 12:39:36.180108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.387s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:39:36.181377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:39:36.195774 n-d-760454-3 sudo[95356]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:39:36.196324 n-d-760454-3 sudo[95356]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:39:36.757528 n-d-760454-3 sudo[95356]: pam_unix(sudo:session): session closed for user root
Jan 25 12:39:36.760177 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:39:36.761077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:40:35.790423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:40:35.791045 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:40:35.791589 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:40:35.805655 n-d-760454-3 sudo[95577]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:40:35.806293 n-d-760454-3 sudo[95577]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:40:36.185921 n-d-760454-3 sudo[95577]: pam_unix(sudo:session): session closed for user root
Jan 25 12:40:36.188018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.396s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:40:36.189292 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:40:36.203102 n-d-760454-3 sudo[95581]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:40:36.203669 n-d-760454-3 sudo[95581]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:40:36.743821 n-d-760454-3 sudo[95581]: pam_unix(sudo:session): session closed for user root
Jan 25 12:40:36.746059 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:40:36.746944 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:41:35.793374 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:41:35.794018 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:41:35.794556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:41:35.808585 n-d-760454-3 sudo[96532]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:41:35.809147 n-d-760454-3 sudo[96532]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:41:36.191938 n-d-760454-3 sudo[96532]: pam_unix(sudo:session): session closed for user root
Jan 25 12:41:36.194041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.399s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:41:36.195366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:41:36.209639 n-d-760454-3 sudo[96536]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:41:36.210198 n-d-760454-3 sudo[96536]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:41:36.786715 n-d-760454-3 sudo[96536]: pam_unix(sudo:session): session closed for user root
Jan 25 12:41:36.788820 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:41:36.790287 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:42:35.798675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:42:35.799282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:42:35.799834 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:42:35.829134 n-d-760454-3 sudo[96781]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:42:35.830765 n-d-760454-3 sudo[96781]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:42:36.387814 n-d-760454-3 sudo[96781]: pam_unix(sudo:session): session closed for user root
Jan 25 12:42:36.390633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:42:36.392074 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:42:36.409986 n-d-760454-3 sudo[96785]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:42:36.411564 n-d-760454-3 sudo[96785]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:42:37.089054 n-d-760454-3 sudo[96785]: pam_unix(sudo:session): session closed for user root
Jan 25 12:42:37.091291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:42:37.092316 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:43:35.797888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:43:35.798336 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:43:35.799091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:35.824268 n-d-760454-3 sudo[97127]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:43:35.825578 n-d-760454-3 sudo[97127]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:36.449941 n-d-760454-3 sudo[97127]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:36.452313 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:36.454206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:36.516070 n-d-760454-3 sudo[97131]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:43:36.519685 n-d-760454-3 sudo[97131]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:37.535913 n-d-760454-3 sudo[97131]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:37.539414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.085s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:37.540806 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:43:44.228068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:43:44.246201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:43:44.258950 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Automatically selected cinder-backup objects version 1.38 as minimum service version.
Jan 25 12:43:44.267372 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version.
Jan 25 12:43:44.280933 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Automatically selected cinder-volume objects version 1.38 as minimum service version.
Jan 25 12:43:44.306370 n-d-760454-3 cinder-volume[89138]: INFO cinder.rpc [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Automatically selected cinder-volume RPC version 3.16 as minimum service version.
Jan 25 12:43:44.308867 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:43:44.311107 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:43:44.394242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Flow 'volume_create_manager' (031ffd8b-f66c-476b-be94-650a9490798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:43:44.399502 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca632a0-1d5b-4cba-9f7d-05eedb57a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:44.432325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:43:44.557235 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca632a0-1d5b-4cba-9f7d-05eedb57a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1246157024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=df60f91e-27fd-4672-b11c-9f7841fcc7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fda27ce5e4de2b9a5c3d9c04ff842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:43:44Z,user_id='6b1c5c29fe0642998a68c6d1217657c7',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:44.560788 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3108187-c5d1-413c-8fe0-f252d0cb3b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:44.563866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3108187-c5d1-413c-8fe0-f252d0cb3b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:44.566523 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258c3622-54a6-4832-971c-b70cf069507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:44.569230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258c3622-54a6-4832-971c-b70cf069507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df60f91e-27fd-4672-b11c-9f7841fcc7b0', 'volume_name': 'volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:44.572472 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf58617-9fed-423d-a5ce-ad5fcdcc6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:44.576426 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf58617-9fed-423d-a5ce-ad5fcdcc6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:44.578250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cbdeb-6fe0-481b-a99f-1b95fe42a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:44.579268 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Volume df60f91e-27fd-4672-b11c-9f7841fcc7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0', 'volume_size': 1}
Jan 25 12:43:44.580725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:44.604253 n-d-760454-3 sudo[97230]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:43:44.604999 n-d-760454-3 sudo[97230]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:45.641533 n-d-760454-3 sudo[97230]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:45.643911 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.063s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:45.647976 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557cbdeb-6fe0-481b-a99f-1b95fe42a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:45.659542 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bc1f7d-de0e-400f-891f-d11903e91a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:43:45.726269 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Volume volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 (df60f91e-27fd-4672-b11c-9f7841fcc7b0): created successfully
Jan 25 12:43:45.731798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bc1f7d-de0e-400f-891f-d11903e91a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:43:45.735752 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Flow 'volume_create_manager' (031ffd8b-f66c-476b-be94-650a9490798a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:43:45.805395 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-73e484cd-eb50-4ce7-acae-b5406816a44a tempest-VolumesAdminNegativeTest-2004636961 None] Created volume successfully.
Jan 25 12:43:49.675839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:49.755833 n-d-760454-3 sudo[97316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
Jan 25 12:43:49.756619 n-d-760454-3 sudo[97316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:50.868102 n-d-760454-3 sudo[97316]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:50.871356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version" returned: 0 in 1.195s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:50.872699 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:50.927062 n-d-760454-3 sudo[97347]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:43:50.927698 n-d-760454-3 sudo[97347]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:51.508795 n-d-760454-3 sudo[97347]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:51.511004 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0" returned: 0 in 0.638s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:51.636971 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8icon6__/privsep.sock']
Jan 25 12:43:51.678462 n-d-760454-3 sudo[97357]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8icon6__/privsep.sock
Jan 25 12:43:51.684832 n-d-760454-3 sudo[97357]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:43:54.530869 n-d-760454-3 sudo[97357]: pam_unix(sudo:session): session closed for user root
Jan 25 12:43:54.536963 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Spawned new privsep daemon via rootwrap
Jan 25 12:43:54.537671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Accepted privsep connection to /tmp/tmp8icon6__/privsep.sock {{(pid=89244) __init__ /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:371}}
Jan 25 12:43:54.539266 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jan 25 12:43:54.539383 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jan 25 12:43:54.539608 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jan 25 12:43:54.539887 n-d-760454-3 cinder-volume[89138]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 97445
Jan 25 12:43:54.568866 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (2,) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:55.476046 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:55.539840 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.063s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:55.541014 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:55.542016 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:43:55.543435 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Creating iscsi_target for Volume ID: volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Created volume path /opt/stack/data/cinder/volumes/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0,
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0>
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:     incominguser EzURoFJwq9nD235sZaQC tQWQ96dQ5SoB5dJp
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:43:55.667812 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:43:55.672391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:56.759166 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0" returned: 0 in 1.086s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:56.760211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:56.761242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:43:56.761792 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:43:56.763603 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:56.787307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.023s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:56.787644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n            Backing store flags: \n    Account information:\n        EzURoFJwq9nD235sZaQC\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:56.788265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:43:56.789459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:57.067938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.276s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:57.067938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n            Backing store flags: \n    Account information:\n        EzURoFJwq9nD235sZaQC\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:57.070553 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:43:57.287437 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.219s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:43:57.287789 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n            Backing store flags: \n    Account information:\n        EzURoFJwq9nD235sZaQC\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:43:57.288890 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:43:57.781858 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-d30d682c-eb39-4b1b-a72b-2d143c7136b3 req-12547ce0-b326-442f-9952-6046082435cf tempest-VolumesAdminNegativeTest-2004636961 None] attachment_update completed successfully.
Jan 25 12:44:12.802147 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-53cbbd11-b8b5-4c7b-bf5f-98d72b5304af req-24c65ab7-a4f8-44df-a672-4704e169a732 tempest-VolumesAdminNegativeTest-2004636961 None] Terminate volume connection completed successfully.
Jan 25 12:44:12.803156 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-53cbbd11-b8b5-4c7b-bf5f-98d72b5304af req-24c65ab7-a4f8-44df-a672-4704e169a732 tempest-VolumesAdminNegativeTest-2004636961 None] Deleting attachment 856c01cb-7d5f-4acb-9d06-94f30c55276e. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:44:12.807168 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:13.068191 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.263s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:13.068781 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0\n            Backing store flags: \n    Account information:\n        EzURoFJwq9nD235sZaQC\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:13.069620 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-53cbbd11-b8b5-4c7b-bf5f-98d72b5304af req-24c65ab7-a4f8-44df-a672-4704e169a732 tempest-VolumesAdminNegativeTest-2004636961 None] Removing iscsi_target for Volume ID: df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:13.073211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:13.355313 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 -f" returned: 0 in 0.281s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:13.357294 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:13.364433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:13.604142 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.241s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:13.604666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:13.868315 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-53cbbd11-b8b5-4c7b-bf5f-98d72b5304af req-24c65ab7-a4f8-44df-a672-4704e169a732 tempest-VolumesAdminNegativeTest-2004636961 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:44:13.868315 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:44:13.868315 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:44:15.925394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:44:15.929736 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:44:15.930619 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:44:15.962989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Flow 'volume_create_manager' (8b6a116f-b881-46cd-bce6-2b52f8fde1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:44:15.971680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140e6ee7-8a9f-4398-8c97-7d9e346b4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.002691 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:44:16.034460 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140e6ee7-8a9f-4398-8c97-7d9e346b4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1367816457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=256f0917-c682-4ac3-8b0b-5fa001879b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fda27ce5e4de2b9a5c3d9c04ff842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:44:16Z,user_id='6b1c5c29fe0642998a68c6d1217657c7',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.038068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27476e0d-3b7d-40db-90d8-bbf65dec263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.040859 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27476e0d-3b7d-40db-90d8-bbf65dec263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.044180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c15498f-9f97-4172-abf6-aec53813d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.049193 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c15498f-9f97-4172-abf6-aec53813d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256f0917-c682-4ac3-8b0b-5fa001879b68', 'volume_name': 'volume-256f0917-c682-4ac3-8b0b-5fa001879b68', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.053254 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ee74a9-9a9a-40aa-b43a-29de96e86039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.056241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ee74a9-9a9a-40aa-b43a-29de96e86039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.059245 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17363e2f-2fb1-4c58-9d1a-c40a15914e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.061769 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Volume 256f0917-c682-4ac3-8b0b-5fa001879b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256f0917-c682-4ac3-8b0b-5fa001879b68', 'volume_size': 1}
Jan 25 12:44:16.063254 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-256f0917-c682-4ac3-8b0b-5fa001879b68 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:16.115268 n-d-760454-3 sudo[98041]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-256f0917-c682-4ac3-8b0b-5fa001879b68 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:44:16.115891 n-d-760454-3 sudo[98041]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:16.875631 n-d-760454-3 sudo[98041]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:16.877891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-256f0917-c682-4ac3-8b0b-5fa001879b68 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.814s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:16.881911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17363e2f-2fb1-4c58-9d1a-c40a15914e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256f0917-c682-4ac3-8b0b-5fa001879b68', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.884369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5f64d-59a6-426c-9f6e-3ba929db9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:16.953492 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Volume volume-256f0917-c682-4ac3-8b0b-5fa001879b68 (256f0917-c682-4ac3-8b0b-5fa001879b68): created successfully
Jan 25 12:44:16.956746 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5f64d-59a6-426c-9f6e-3ba929db9335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:16.960095 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Flow 'volume_create_manager' (8b6a116f-b881-46cd-bce6-2b52f8fde1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:44:17.015102 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a97f0b27-fe55-4405-92f2-310706ae9221 tempest-VolumesAdminNegativeTest-2004636961 None] Created volume successfully.
Jan 25 12:44:18.798394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Lock "b'cinder-256f0917-c682-4ac3-8b0b-5fa001879b68-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 12:44:18.973621 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Skipping remove_export. No iscsi_target is presently exported for volume: 256f0917-c682-4ac3-8b0b-5fa001879b68
Jan 25 12:44:18.974479 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:19.004035 n-d-760454-3 sudo[98160]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68
Jan 25 12:44:19.005136 n-d-760454-3 sudo[98160]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:19.633528 n-d-760454-3 sudo[98160]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:19.635761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68" returned: 0 in 0.661s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:19.637009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:19.684128 n-d-760454-3 sudo[98180]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68
Jan 25 12:44:19.684746 n-d-760454-3 sudo[98180]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:20.292288 n-d-760454-3 sudo[98180]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:20.294487 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68" returned: 0 in 0.657s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:20.297551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:20.322900 n-d-760454-3 sudo[98213]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68
Jan 25 12:44:20.324122 n-d-760454-3 sudo[98213]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:21.181121 n-d-760454-3 sudo[98213]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:21.183524 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-256f0917-c682-4ac3-8b0b-5fa001879b68" returned: 0 in 0.885s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:21.184903 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Successfully deleted volume: 256f0917-c682-4ac3-8b0b-5fa001879b68
Jan 25 12:44:21.288665 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Deprecated: Default quota for resource: volumes_lvmdriver-1 is set by the default quota flag: quota_volumes_lvmdriver-1, it is now deprecated. Please use the default quota class for default quota.
Jan 25 12:44:21.303333 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Deprecated: Default quota for resource: gigabytes_lvmdriver-1 is set by the default quota flag: quota_gigabytes_lvmdriver-1, it is now deprecated. Please use the default quota class for default quota.
Jan 25 12:44:21.399647 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Created reservations ['bab04c51-0cc4-4dbb-b1e0-e8d9c9e14957', 'bb062b99-394b-4464-aed7-466889fcb49f', '87c9a594-6b34-477d-bda2-295af5042171', '7c814402-17dc-4617-b79b-d628a878b5a5'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 12:44:21.404057 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:44:21.404057 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:44:21.404057 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:44:21.656407 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:44:21.657358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:21.711711 n-d-760454-3 sudo[98293]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:44:21.714328 n-d-760454-3 sudo[98293]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:22.712501 n-d-760454-3 sudo[98293]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:22.722284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.065s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:22.747737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:22.788700 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:44:22.796120 n-d-760454-3 sudo[98325]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:44:22.797391 n-d-760454-3 sudo[98325]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:22.803099 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:44:22.803686 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:44:22.844280 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Flow 'volume_create_manager' (38a338f8-aedc-44b0-a384-a2fdedda9501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:44:22.848217 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b3d1c9-310e-46e4-8c62-701bf7b2c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:22.960347 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:44:23.031930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b3d1c9-310e-46e4-8c62-701bf7b2c94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-2080221416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=07dd4dcc-6edb-4ac3-bdc7-24e156c4a824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c537a2f429004c7dbb805af6c1d6edfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:44:23Z,user_id='cbb608c5f53f45d1ac86b9c47af9f482',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:23.035054 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c8bbe-a97d-4bb5-a58e-f7a8c05e700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:23.037586 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c8bbe-a97d-4bb5-a58e-f7a8c05e700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:23.040635 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c992b0-8c22-4509-b3a4-79c29607f95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:23.043448 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c992b0-8c22-4509-b3a4-79c29607f95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07dd4dcc-6edb-4ac3-bdc7-24e156c4a824', 'volume_name': 'volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:23.053593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041da2da-3527-4024-9d4e-7f1ceb83ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:23.056022 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041da2da-3527-4024-9d4e-7f1ceb83ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:23.058486 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35501bf8-e6d5-4a18-b76f-8c62d523aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:23.059442 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Volume 07dd4dcc-6edb-4ac3-bdc7-24e156c4a824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824', 'volume_size': 1}
Jan 25 12:44:23.061517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:23.131831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Lock "b'cinder-df60f91e-27fd-4672-b11c-9f7841fcc7b0-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 12:44:23.138215 n-d-760454-3 sudo[98337]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:44:23.138787 n-d-760454-3 sudo[98337]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:23.352551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:23.549761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.199s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:23.550298 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700514254168]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:23.551160 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Skipping remove_export. No iscsi_target is presently exported for volume: df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:23.552217 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:23.584950 n-d-760454-3 sudo[98358]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:23.585588 n-d-760454-3 sudo[98358]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:23.895332 n-d-760454-3 sudo[98325]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:23.897804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.150s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:23.900982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:44:23.915926 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Deleted volume successfully.
Jan 25 12:44:23.971823 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-47f202e7-370a-4383-a0ec-4e882fcb07b0 tempest-VolumesAdminNegativeTest-2004636961 None] Lock "b'cinder-256f0917-c682-4ac3-8b0b-5fa001879b68-delete_volume'" released by "delete_volume" :: held 5.173s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 12:44:24.293588 n-d-760454-3 sudo[98358]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:24.295344 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0" returned: 0 in 0.743s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:24.296366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:24.362233 n-d-760454-3 sudo[98395]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:24.367080 n-d-760454-3 sudo[98395]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:24.483716 n-d-760454-3 sudo[98337]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:24.487378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.426s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:24.491596 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35501bf8-e6d5-4a18-b76f-8c62d523aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:24.495080 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8201747-b95b-46f1-a7ba-5e4a6782ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:44:24.558105 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Volume volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 (07dd4dcc-6edb-4ac3-bdc7-24e156c4a824): created successfully
Jan 25 12:44:24.560800 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8201747-b95b-46f1-a7ba-5e4a6782ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:44:24.564818 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Flow 'volume_create_manager' (38a338f8-aedc-44b0-a384-a2fdedda9501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:44:24.625981 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7f1fd8d0-9b71-4b8f-9015-ce0c78596775 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Created volume successfully.
Jan 25 12:44:24.932942 n-d-760454-3 sudo[98395]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:24.934641 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0" returned: 0 in 0.638s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:24.937196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:24.957360 n-d-760454-3 sudo[98409]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:24.958340 n-d-760454-3 sudo[98409]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:25.595109 n-d-760454-3 sudo[98409]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:25.597776 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-df60f91e-27fd-4672-b11c-9f7841fcc7b0" returned: 0 in 0.660s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:25.600116 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Successfully deleted volume: df60f91e-27fd-4672-b11c-9f7841fcc7b0
Jan 25 12:44:25.752774 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Created reservations ['3c93b1b6-20ea-4a14-9142-a98983ee2d10', '76d780f2-5d59-4125-adc5-44aed0122554', 'e7bf0d6e-146d-46fb-a559-77ecdbb56b7a', 'b5b1c917-ee9f-4634-b9b5-28f9e95aa970'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 12:44:25.755892 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:44:25.755892 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:44:25.755892 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:44:25.908153 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:44:25.909149 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:25.943744 n-d-760454-3 sudo[98418]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:44:25.948192 n-d-760454-3 sudo[98418]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:26.463529 n-d-760454-3 sudo[98418]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:26.466038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:26.468894 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:26.497289 n-d-760454-3 sudo[98433]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:44:26.499406 n-d-760454-3 sudo[98433]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:27.468758 n-d-760454-3 sudo[98433]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:27.470940 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.002s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:27.473894 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:44:27.498788 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Deleted volume successfully.
Jan 25 12:44:27.548824 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f678aa82-a16d-48a7-9f7a-7ca854841b71 tempest-VolumesAdminNegativeTest-2004636961 None] Lock "b'cinder-df60f91e-27fd-4672-b11c-9f7841fcc7b0-delete_volume'" released by "delete_volume" :: held 4.417s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 12:44:27.693066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:27.712600 n-d-760454-3 sudo[98494]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:27.713702 n-d-760454-3 sudo[98494]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:28.225544 n-d-760454-3 sudo[98494]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:28.227943 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.535s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:28.306769 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:28.323369 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:28.323947 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:28.324813 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:44:28.326656 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Creating iscsi_target for Volume ID: volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Created volume path /opt/stack/data/cinder/volumes/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824,
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824>
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:     incominguser rHUbaviJpPu4G4266WVR 4MNgwPKjN5SSigaL
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:44:28.409798 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:44:28.415087 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:29.144034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.730s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:29.144728 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:29.145069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:44:29.145616 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:44:29.150515 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:29.157466 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.010s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:29.158224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:29.158735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:44:29.160680 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:29.301976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.142s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:29.302304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:29.304956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:29.402246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.097s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:29.402808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:29.404111 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:44:29.695112 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-190f9d63-a3d1-4d53-b281-647105e7f614 req-cedfa528-8aa4-4ac6-a856-d89fa77c7190 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] attachment_update completed successfully.
Jan 25 12:44:35.810616 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:44:35.811167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:44:35.811759 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:35.859144 n-d-760454-3 sudo[98601]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:44:35.861547 n-d-760454-3 sudo[98601]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:37.298876 n-d-760454-3 sudo[98601]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:37.301661 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.490s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:37.303272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:37.483551 n-d-760454-3 sudo[98630]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:44:37.485413 n-d-760454-3 sudo[98630]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:39.267304 n-d-760454-3 sudo[98630]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:39.269960 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:39.271322 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:44:53.650764 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:53.761560 n-d-760454-3 sudo[98795]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:53.762156 n-d-760454-3 sudo[98795]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:44:54.541755 n-d-760454-3 sudo[98795]: pam_unix(sudo:session): session closed for user root
Jan 25 12:44:54.544844 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.893s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:54.647891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:54.667471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.022s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:54.669044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 2\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 2
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         rHUbaviJpPu4G4266WVR
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:44:54.670160 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:44:54.674567 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Creating iscsi_target for Volume ID: volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:44:54.676057 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Persistence file already exists for volume, found file at: /opt/stack/data/cinder/volumes/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:153}}
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Created volume path /opt/stack/data/cinder/volumes/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824,
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824>
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:     incominguser rHUbaviJpPu4G4266WVR 4MNgwPKjN5SSigaL
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:44:54.779013 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:44:54.781375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:55.307545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.526s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:55.308015 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:55.308726 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:44:55.309349 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:44:55.310906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:55.335864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.024s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:55.336658 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 2\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 2
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         rHUbaviJpPu4G4266WVR
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:44:55.337473 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:44:55.342055 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:55.431380 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.089s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:55.431743 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 2\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:55.433224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:44:55.560273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.126s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:44:55.565447 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 2\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:44:55.565645 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:44:55.971169 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-09a461f4-de91-4ed6-afd3-aa81a81db44f tempest-LiveAutoBlockMigrationV225Test-1750839872 None] attachment_update completed successfully.
Jan 25 12:45:17.522966 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-083118de-aede-47bf-91ee-7c221ed8c2a5 tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Terminate volume connection completed successfully.
Jan 25 12:45:17.524086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-083118de-aede-47bf-91ee-7c221ed8c2a5 tempest-LiveAutoBlockMigrationV225Test-1750839872 None] Deleting attachment 9bacec08-4743-4750-b78e-4af6a3e6f19d. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:45:17.655849 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-8b66c2f4-557b-42a8-91c2-5e5a22b34e45 req-083118de-aede-47bf-91ee-7c221ed8c2a5 tempest-LiveAutoBlockMigrationV225Test-1750839872 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:45:17.655849 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:45:17.655849 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:45:35.811731 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:45:35.812294 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:45:35.812839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:35.827501 n-d-760454-3 sudo[99232]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:45:35.828221 n-d-760454-3 sudo[99232]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:45:36.270350 n-d-760454-3 sudo[99232]: pam_unix(sudo:session): session closed for user root
Jan 25 12:45:36.273901 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:36.276247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:36.308287 n-d-760454-3 sudo[99241]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:45:36.309826 n-d-760454-3 sudo[99241]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:45:36.929726 n-d-760454-3 sudo[99241]: pam_unix(sudo:session): session closed for user root
Jan 25 12:45:36.932339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:36.934388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:45:51.168946 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-64792c86-e4e4-48cb-8828-1ab8af717dfb req-ccc93619-f466-4969-9662-6d4479c9a2e4 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Terminate volume connection completed successfully.
Jan 25 12:45:51.169958 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-64792c86-e4e4-48cb-8828-1ab8af717dfb req-ccc93619-f466-4969-9662-6d4479c9a2e4 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Deleting attachment f364ba93-01fb-40bc-921d-7f0d59e37736. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:45:51.173902 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:51.284856 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.112s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:51.285373 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824\n            Backing store flags: \n    Account information:\n        rHUbaviJpPu4G4266WVR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:45:51.286225 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-64792c86-e4e4-48cb-8828-1ab8af717dfb req-ccc93619-f466-4969-9662-6d4479c9a2e4 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Removing iscsi_target for Volume ID: 07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:45:51.289199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:51.378275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 -f" returned: 0 in 0.090s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:51.380137 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:45:51.384597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:51.478615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.093s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:51.479777 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:45:51.591979 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-64792c86-e4e4-48cb-8828-1ab8af717dfb req-ccc93619-f466-4969-9662-6d4479c9a2e4 tempest-LiveAutoBlockMigrationV225Test-1794584986 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:45:51.591979 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:45:51.591979 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:45:56.774646 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:45:56.779037 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:45:56.779606 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:45:56.792834 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Flow 'volume_create_manager' (603fa631-4b70-413c-890f-bc61c24b1680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:45:56.796020 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f564304d-9071-46df-af06-b046303d7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:56.820077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:45:56.847064 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f564304d-9071-46df-af06-b046303d7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1945754865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=6c367f60-6aff-4e22-87b4-fbc3aba378b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3b1a07fd124268bdf26eb9e7ab54de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:45:57Z,user_id='c4938feba8964ff6818a1554b4f5816c',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:56.849662 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba6779f-833c-4104-aa95-d356bb1a3979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:56.851875 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba6779f-833c-4104-aa95-d356bb1a3979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:56.854850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b87b59-f218-439b-8d34-f1fe529a411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:56.857341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b87b59-f218-439b-8d34-f1fe529a411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c367f60-6aff-4e22-87b4-fbc3aba378b8', 'volume_name': 'volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:56.859913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc4dc7a-7b2b-48fb-8d85-a1627b62fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:56.862122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc4dc7a-7b2b-48fb-8d85-a1627b62fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:56.864354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e647387-c5e0-4c79-b9a9-4f83051443ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:56.865183 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Volume 6c367f60-6aff-4e22-87b4-fbc3aba378b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8', 'volume_size': 1}
Jan 25 12:45:56.866198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:45:56.892252 n-d-760454-3 sudo[99341]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:45:56.893937 n-d-760454-3 sudo[99341]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:45:57.700459 n-d-760454-3 sudo[99341]: pam_unix(sudo:session): session closed for user root
Jan 25 12:45:57.702673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.836s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:45:57.708029 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e647387-c5e0-4c79-b9a9-4f83051443ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:57.710939 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9e512a-d196-4e04-b183-091b17ddc240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:45:57.753417 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Volume volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 (6c367f60-6aff-4e22-87b4-fbc3aba378b8): created successfully
Jan 25 12:45:57.756469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9e512a-d196-4e04-b183-091b17ddc240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:45:57.760811 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Flow 'volume_create_manager' (603fa631-4b70-413c-890f-bc61c24b1680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:45:57.847595 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-be262a46-dbc5-475e-af49-c9fb0b3a0652 tempest-AttachSCSIVolumeTestJSON-734077951 None] Created volume successfully.
Jan 25 12:46:03.043536 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:03.058834 n-d-760454-3 sudo[99394]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:03.059448 n-d-760454-3 sudo[99394]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:03.413330 n-d-760454-3 sudo[99394]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:03.415573 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8" returned: 0 in 0.372s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:03.466908 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:03.472570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:03.472933 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:03.473571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:46:03.474463 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Creating iscsi_target for Volume ID: volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Created volume path /opt/stack/data/cinder/volumes/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8,
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8>
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:     incominguser pJZNZEwViwBvTTWDgX4P 7PAnR9hhcf77QVQd
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:46:03.540001 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:46:03.542772 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:03.988757 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8" returned: 0 in 0.446s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:03.989136 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:03.990074 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:46:03.990765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:46:03.992084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:03.999952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:04.000407 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n            Backing store flags: \n    Account information:\n        pJZNZEwViwBvTTWDgX4P\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:04.001101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:46:04.002226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:04.090187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.087s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:04.090693 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n            Backing store flags: \n    Account information:\n        pJZNZEwViwBvTTWDgX4P\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:04.092429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:04.173890 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.082s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:04.174482 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n            Backing store flags: \n    Account information:\n        pJZNZEwViwBvTTWDgX4P\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:04.175651 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:46:04.431191 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-4f9e409e-11b2-49e0-8293-321895d41265 req-c1e19b19-7374-46a3-96d2-21d218f3dc4d tempest-AttachSCSIVolumeTestJSON-734077951 None] attachment_update completed successfully.
Jan 25 12:46:17.004589 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-30ba7f95-724e-4cdc-b64d-1f01cdcbd39a req-577f6874-26a4-4f4a-9dd9-f4a46abe5987 tempest-AttachSCSIVolumeTestJSON-734077951 None] Terminate volume connection completed successfully.
Jan 25 12:46:17.005735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-30ba7f95-724e-4cdc-b64d-1f01cdcbd39a req-577f6874-26a4-4f4a-9dd9-f4a46abe5987 tempest-AttachSCSIVolumeTestJSON-734077951 None] Deleting attachment 0cf40db2-7669-4366-837f-43f06534d8c8. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:46:17.009903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:17.091926 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:17.092598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8\n            Backing store flags: \n    Account information:\n        pJZNZEwViwBvTTWDgX4P\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:17.093340 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-30ba7f95-724e-4cdc-b64d-1f01cdcbd39a req-577f6874-26a4-4f4a-9dd9-f4a46abe5987 tempest-AttachSCSIVolumeTestJSON-734077951 None] Removing iscsi_target for Volume ID: 6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:17.096392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:17.206475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 -f" returned: 0 in 0.111s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:17.207454 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:17.210525 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:17.388954 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.179s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:17.389847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:17.582289 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-30ba7f95-724e-4cdc-b64d-1f01cdcbd39a req-577f6874-26a4-4f4a-9dd9-f4a46abe5987 tempest-AttachSCSIVolumeTestJSON-734077951 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:46:17.582289 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:46:17.582289 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:46:21.406061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:46:21.410282 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:46:21.410785 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:46:21.424771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Flow 'volume_create_manager' (572503bb-c944-464a-aeb4-84a83edb2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:46:21.428556 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab29bd0f-a661-4a91-9fc0-cbe08d4c5073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:21.451931 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:46:21.479267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab29bd0f-a661-4a91-9fc0-cbe08d4c5073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1140527069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=9ba3740c-9e4a-48a6-97ae-3ca0d7039621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc79ada4a6244b39262eefde8214d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:46:21Z,user_id='b5668ad064ad4809b069e543a5cdaf43',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:21.481876 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab537e2-730a-479b-a109-62c2d1c12f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:21.484334 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab537e2-730a-479b-a109-62c2d1c12f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:21.486935 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9fd501-aec5-42d6-a1c7-9627f5d40b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:21.489475 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9fd501-aec5-42d6-a1c7-9627f5d40b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba3740c-9e4a-48a6-97ae-3ca0d7039621', 'volume_name': 'volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:21.494449 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a590cb-cb33-4a9e-83fa-7ca662e57a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:21.494449 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a590cb-cb33-4a9e-83fa-7ca662e57a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:21.496222 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82081e75-20dc-480e-9e12-e56875617565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:21.497074 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Volume 9ba3740c-9e4a-48a6-97ae-3ca0d7039621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621', 'volume_size': 1}
Jan 25 12:46:21.498146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:21.513665 n-d-760454-3 sudo[99523]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:46:21.514235 n-d-760454-3 sudo[99523]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:22.093959 n-d-760454-3 sudo[99523]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:22.096225 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.598s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:22.099895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82081e75-20dc-480e-9e12-e56875617565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:22.102448 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cdbdea-ffb5-4c01-bb9f-5dce45da4c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:46:22.150406 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Volume volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 (9ba3740c-9e4a-48a6-97ae-3ca0d7039621): created successfully
Jan 25 12:46:22.153614 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cdbdea-ffb5-4c01-bb9f-5dce45da4c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:46:22.170867 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Flow 'volume_create_manager' (572503bb-c944-464a-aeb4-84a83edb2619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:46:22.213554 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c22fc3f0-d710-4096-8b74-a8ff42689a51 tempest-LiveMigrationTest-949746485 None] Created volume successfully.
Jan 25 12:46:25.166409 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:25.182508 n-d-760454-3 sudo[99571]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:25.183217 n-d-760454-3 sudo[99571]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:25.608514 n-d-760454-3 sudo[99571]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:25.611123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.445s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:25.669311 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:25.676795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:25.677343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:25.678256 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:46:25.679363 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Creating iscsi_target for Volume ID: volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Created volume path /opt/stack/data/cinder/volumes/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621,
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621>
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:     incominguser yMuW65cmR7u2AP7PEw5p Ats54C272sJzMVkh
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:46:25.745680 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:46:25.758133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:26.177479 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.419s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:26.177964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:26.178484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:46:26.178855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:46:26.180288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:26.188595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.008s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:26.188595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:26.189446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:46:26.190523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:26.281711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.090s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:26.282087 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:26.286673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:26.375390 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.090s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:26.375390 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:26.376193 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:46:26.632344 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-612b1d3c-beaa-496e-b563-5db8bf16056b req-84131f99-ee71-4354-ac43-b69d085ffd44 tempest-LiveMigrationTest-949746485 None] attachment_update completed successfully.
Jan 25 12:46:34.238499 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Lock "b'cinder-6c367f60-6aff-4e22-87b4-fbc3aba378b8-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 12:46:34.339838 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:34.474804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.137s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:34.476091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 5\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:34.477853 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Skipping remove_export. No iscsi_target is presently exported for volume: 6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:34.482286 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:34.527305 n-d-760454-3 sudo[99676]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:34.529250 n-d-760454-3 sudo[99676]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:35.127083 n-d-760454-3 sudo[99676]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:35.129721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8" returned: 0 in 0.649s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:35.140408 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:35.151380 n-d-760454-3 sudo[99682]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:35.151926 n-d-760454-3 sudo[99682]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:35.604710 n-d-760454-3 sudo[99682]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:35.609981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8" returned: 0 in 0.478s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:35.613208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:35.641591 n-d-760454-3 sudo[99691]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:35.642615 n-d-760454-3 sudo[99691]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:35.812704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:46:35.813279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:46:35.814644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:35.870668 n-d-760454-3 sudo[99701]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:46:35.878357 n-d-760454-3 sudo[99701]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:36.426484 n-d-760454-3 sudo[99691]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:36.429714 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6c367f60-6aff-4e22-87b4-fbc3aba378b8" returned: 0 in 0.816s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:36.431565 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Successfully deleted volume: 6c367f60-6aff-4e22-87b4-fbc3aba378b8
Jan 25 12:46:36.524123 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Created reservations ['b2f427c0-928a-4365-a1df-1e3839e1358d', '49a33151-194d-4a7e-8ac5-3ba1dc56b8f7', 'ac2e758e-8420-4f9d-92b5-ae5720661db9', '69941e33-df99-431e-95c5-12cbfe78f0e2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 12:46:36.526689 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:46:36.526689 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:46:36.526689 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:46:36.560049 n-d-760454-3 sudo[99701]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:36.561863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:36.563150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:36.583094 n-d-760454-3 sudo[99718]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:46:36.583648 n-d-760454-3 sudo[99718]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:36.719281 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:46:36.721779 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:36.767894 n-d-760454-3 sudo[99720]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:46:36.769047 n-d-760454-3 sudo[99720]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:37.288334 n-d-760454-3 sudo[99720]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:37.293608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:37.293608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:37.313301 n-d-760454-3 sudo[99728]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:46:37.313884 n-d-760454-3 sudo[99728]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:37.370162 n-d-760454-3 sudo[99718]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:37.372857 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.809s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:37.374758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:46:38.112918 n-d-760454-3 sudo[99728]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:38.114804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.822s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:38.115421 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:46:38.121090 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Deleted volume successfully.
Jan 25 12:46:38.182483 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f22b09ac-2575-45ac-b123-9580a03812e5 tempest-AttachSCSIVolumeTestJSON-734077951 None] Lock "b'cinder-6c367f60-6aff-4e22-87b4-fbc3aba378b8-delete_volume'" released by "delete_volume" :: held 3.944s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 12:46:44.067422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:44.084294 n-d-760454-3 sudo[99774]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.084939 n-d-760454-3 sudo[99774]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:46:44.569478 n-d-760454-3 sudo[99774]: pam_unix(sudo:session): session closed for user root
Jan 25 12:46:44.573333 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.509s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:44.631303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:44.638187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:44.638750 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 5\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 5
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         yMuW65cmR7u2AP7PEw5p
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:46:44.639604 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:46:44.643964 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Creating iscsi_target for Volume ID: volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:46:44.644388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Persistence file already exists for volume, found file at: /opt/stack/data/cinder/volumes/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:153}}
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Created volume path /opt/stack/data/cinder/volumes/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621,
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621>
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:     incominguser yMuW65cmR7u2AP7PEw5p Ats54C272sJzMVkh
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:46:44.719206 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:46:44.730124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:44.946833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.221s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:44.947310 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:44.948020 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:46:44.948462 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:46:44.950111 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:44.973040 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.022s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:44.973407 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 5\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 5
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         yMuW65cmR7u2AP7PEw5p
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:46:44.974103 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:46:44.976670 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:45.146514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.170s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:45.147314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 5\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:45.148808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:46:45.279712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.130s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:46:45.280381 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 5\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:46:45.281789 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:46:45.795295 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-ccc5d887-f78e-4040-922c-2434ba584326 tempest-LiveMigrationTest-1081091207 None] attachment_update completed successfully.
Jan 25 12:47:08.263521 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-2a72db4c-3413-443d-a66e-bda5780183d5 tempest-LiveMigrationTest-1081091207 None] Terminate volume connection completed successfully.
Jan 25 12:47:08.267871 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-2a72db4c-3413-443d-a66e-bda5780183d5 tempest-LiveMigrationTest-1081091207 None] Deleting attachment ddcf76bd-4814-4759-b925-2dbdcc8a8525. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:47:08.520090 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-935fec92-0c74-48be-a6e1-cbe3a6774718 req-2a72db4c-3413-443d-a66e-bda5780183d5 tempest-LiveMigrationTest-1081091207 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:47:08.520090 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:47:08.520090 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:47:35.813469 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:47:35.814581 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:47:35.815552 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:47:35.859422 n-d-760454-3 sudo[100087]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:47:35.859985 n-d-760454-3 sudo[100087]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:47:36.527532 n-d-760454-3 sudo[100087]: pam_unix(sudo:session): session closed for user root
Jan 25 12:47:36.537123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:47:36.543111 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:47:36.630021 n-d-760454-3 sudo[100095]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:47:36.631972 n-d-760454-3 sudo[100095]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:47:37.592948 n-d-760454-3 sudo[100095]: pam_unix(sudo:session): session closed for user root
Jan 25 12:47:37.595795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.053s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:47:37.597138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:47:41.167385 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-f5f9bf02-bd6f-4f0e-9b77-2fa9f1bafdf4 req-760eebcb-057b-489b-b852-0ac24a74cdf3 tempest-LiveMigrationTest-949746485 None] Terminate volume connection completed successfully.
Jan 25 12:47:41.168592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-f5f9bf02-bd6f-4f0e-9b77-2fa9f1bafdf4 req-760eebcb-057b-489b-b852-0ac24a74cdf3 tempest-LiveMigrationTest-949746485 None] Deleting attachment 8ba0cf4e-6e98-4a8c-809f-a88fd2878863. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:47:41.172436 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:47:41.275119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.104s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:47:41.275737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621\n            Backing store flags: \n    Account information:\n        yMuW65cmR7u2AP7PEw5p\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:47:41.276743 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-f5f9bf02-bd6f-4f0e-9b77-2fa9f1bafdf4 req-760eebcb-057b-489b-b852-0ac24a74cdf3 tempest-LiveMigrationTest-949746485 None] Removing iscsi_target for Volume ID: 9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:47:41.281762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:47:41.514210 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 -f" returned: 0 in 0.232s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:47:41.514802 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:47:41.522224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:47:41.672356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.153s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:47:41.672696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:47:41.849709 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-f5f9bf02-bd6f-4f0e-9b77-2fa9f1bafdf4 req-760eebcb-057b-489b-b852-0ac24a74cdf3 tempest-LiveMigrationTest-949746485 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:47:41.849709 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:47:41.849709 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:48:35.818084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:48:35.818809 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:48:35.819456 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:48:35.843664 n-d-760454-3 sudo[100734]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:48:35.844961 n-d-760454-3 sudo[100734]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:48:36.258383 n-d-760454-3 sudo[100734]: pam_unix(sudo:session): session closed for user root
Jan 25 12:48:36.260772 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:48:36.266995 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:48:36.287990 n-d-760454-3 sudo[100738]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:48:36.289084 n-d-760454-3 sudo[100738]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:48:36.976092 n-d-760454-3 sudo[100738]: pam_unix(sudo:session): session closed for user root
Jan 25 12:48:36.978474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:48:36.980167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:49:12.798441 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Lock "b'cinder-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 12:49:12.954323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:13.071271 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.122s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:13.071837 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:49:13.072646 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Skipping remove_export. No iscsi_target is presently exported for volume: 07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:49:13.073507 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:13.090385 n-d-760454-3 sudo[100874]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:49:13.091032 n-d-760454-3 sudo[100874]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:13.639002 n-d-760454-3 sudo[100874]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:13.642911 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.569s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:13.644756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:13.660662 n-d-760454-3 sudo[100879]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:49:13.661368 n-d-760454-3 sudo[100879]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:14.063179 n-d-760454-3 sudo[100879]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:14.065349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.421s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:14.067875 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:14.083271 n-d-760454-3 sudo[100885]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:49:14.084717 n-d-760454-3 sudo[100885]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:14.589417 n-d-760454-3 sudo[100885]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:14.591734 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824" returned: 0 in 0.523s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:14.593228 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Successfully deleted volume: 07dd4dcc-6edb-4ac3-bdc7-24e156c4a824
Jan 25 12:49:14.671026 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Created reservations ['11071dae-ef3a-4953-bdbd-f574fa477a9c', '8a26c905-6ea4-47a3-aa46-2e819d7898a5', '0e333f6e-27cf-401b-9754-5074b84b835a', '2917cce3-89ba-42a7-bf9c-1f383c54da0d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 12:49:14.675593 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:49:14.675593 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:49:14.675593 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:49:14.841982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:49:14.842859 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:14.860684 n-d-760454-3 sudo[100894]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:49:14.861490 n-d-760454-3 sudo[100894]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:15.236893 n-d-760454-3 sudo[100894]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:15.239795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.396s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:15.241806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:15.256757 n-d-760454-3 sudo[100898]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:49:15.257325 n-d-760454-3 sudo[100898]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:15.712958 n-d-760454-3 sudo[100898]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:15.715526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:15.718062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:49:15.724838 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Deleted volume successfully.
Jan 25 12:49:15.783658 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e12f1253-d19c-475b-8c65-0b4da13a027c tempest-LiveAutoBlockMigrationV225Test-1794584986 None] Lock "b'cinder-07dd4dcc-6edb-4ac3-bdc7-24e156c4a824-delete_volume'" released by "delete_volume" :: held 2.986s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 12:49:35.817504 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:49:35.818057 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:49:35.819890 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:35.838449 n-d-760454-3 sudo[100931]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:49:35.839082 n-d-760454-3 sudo[100931]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:36.512171 n-d-760454-3 sudo[100931]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:36.514543 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:36.517166 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:49:36.545715 n-d-760454-3 sudo[100935]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:49:36.554100 n-d-760454-3 sudo[100935]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:49:37.350916 n-d-760454-3 sudo[100935]: pam_unix(sudo:session): session closed for user root
Jan 25 12:49:37.353271 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.836s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:49:37.354254 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:50:35.817491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:50:35.818074 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:50:35.818590 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:35.839765 n-d-760454-3 sudo[101338]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:50:35.841553 n-d-760454-3 sudo[101338]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:36.319315 n-d-760454-3 sudo[101338]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:36.323308 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:36.323308 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:36.342555 n-d-760454-3 sudo[101342]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:50:36.344763 n-d-760454-3 sudo[101342]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:37.043690 n-d-760454-3 sudo[101342]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:37.046121 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:37.047582 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:50:42.938845 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Lock "b'cinder-9ba3740c-9e4a-48a6-97ae-3ca0d7039621-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 12:50:43.166027 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:43.277400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.104s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:43.277830 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:50:43.278637 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Skipping remove_export. No iscsi_target is presently exported for volume: 9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:50:43.279599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:43.316027 n-d-760454-3 sudo[101443]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:50:43.322332 n-d-760454-3 sudo[101443]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:44.010907 n-d-760454-3 sudo[101443]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:44.014913 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.733s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:44.016906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:44.037504 n-d-760454-3 sudo[101447]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:50:44.038563 n-d-760454-3 sudo[101447]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:44.511308 n-d-760454-3 sudo[101447]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:44.514134 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.497s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:44.517309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:44.534685 n-d-760454-3 sudo[101451]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:50:44.535861 n-d-760454-3 sudo[101451]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:45.289560 n-d-760454-3 sudo[101451]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:45.292920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9ba3740c-9e4a-48a6-97ae-3ca0d7039621" returned: 0 in 0.775s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:45.295374 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Successfully deleted volume: 9ba3740c-9e4a-48a6-97ae-3ca0d7039621
Jan 25 12:50:45.420122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Created reservations ['74878233-3dd8-4f8f-994c-2a547007a4dc', 'df717a85-46ee-4294-a2bf-5875913515a9', '62f497b9-9d20-402a-869a-ae31227e0a35', 'fb1269b2-17a9-4d4b-a5cf-72c821964657'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 12:50:45.423990 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:50:45.423990 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:50:45.423990 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:50:45.585521 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:50:45.587686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:45.617561 n-d-760454-3 sudo[101460]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:50:45.618550 n-d-760454-3 sudo[101460]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:46.158209 n-d-760454-3 sudo[101460]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:46.161748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:46.165915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:50:46.229585 n-d-760454-3 sudo[101464]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:50:46.231669 n-d-760454-3 sudo[101464]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:50:46.998977 n-d-760454-3 sudo[101464]: pam_unix(sudo:session): session closed for user root
Jan 25 12:50:47.002113 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.836s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:50:47.004458 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:50:47.020073 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Deleted volume successfully.
Jan 25 12:50:47.061509 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b0023985-1a40-4163-83f7-d6704964a812 tempest-LiveMigrationTest-949746485 None] Lock "b'cinder-9ba3740c-9e4a-48a6-97ae-3ca0d7039621-delete_volume'" released by "delete_volume" :: held 4.125s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 12:51:35.813620 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:51:35.814180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:51:35.814788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:51:35.861934 n-d-760454-3 sudo[101981]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:51:35.863084 n-d-760454-3 sudo[101981]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:51:36.705667 n-d-760454-3 sudo[101981]: pam_unix(sudo:session): session closed for user root
Jan 25 12:51:36.708349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:51:36.709585 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:51:36.755454 n-d-760454-3 sudo[102000]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:51:36.756553 n-d-760454-3 sudo[102000]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:51:37.771606 n-d-760454-3 sudo[102000]: pam_unix(sudo:session): session closed for user root
Jan 25 12:51:37.775173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.065s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:51:37.776412 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:52:35.821175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:52:35.821677 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:52:35.822352 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:52:35.896156 n-d-760454-3 sudo[102469]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:52:35.897086 n-d-760454-3 sudo[102469]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:52:36.718862 n-d-760454-3 sudo[102469]: pam_unix(sudo:session): session closed for user root
Jan 25 12:52:36.721808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.898s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:52:36.723296 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:52:36.760033 n-d-760454-3 sudo[102479]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:52:36.760639 n-d-760454-3 sudo[102479]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:52:37.715583 n-d-760454-3 sudo[102479]: pam_unix(sudo:session): session closed for user root
Jan 25 12:52:37.718103 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.995s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:52:37.719849 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:53:35.820032 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:53:35.820032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:53:35.820724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:53:35.859477 n-d-760454-3 sudo[103012]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:53:35.863953 n-d-760454-3 sudo[103012]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:53:36.499774 n-d-760454-3 sudo[103012]: pam_unix(sudo:session): session closed for user root
Jan 25 12:53:36.502330 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:53:36.503667 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:53:36.522421 n-d-760454-3 sudo[103018]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:53:36.523924 n-d-760454-3 sudo[103018]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:53:37.447999 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.942s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:53:37.447999 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:53:37.443410 n-d-760454-3 sudo[103018]: pam_unix(sudo:session): session closed for user root
Jan 25 12:53:42.007516 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:53:42.012405 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:53:42.012993 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:53:42.041572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (2566c757-ec7d-46b9-aa70-4281d70df14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:53:42.044275 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dc60df-0981-4072-a134-8f0cf53a1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:53:42.102040 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:53:42.141318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dc60df-0981-4072-a134-8f0cf53a1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-590233681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=44834ab0-65a7-44b6-be11-74cf2eb5eca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1616cd8259b845a0a028b709078c24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:53:42Z,user_id='b985b2f119474fb9898b38d54c64e610',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:53:42.144296 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5b1b75-cdd9-4602-a07e-c4cab9e36158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:53:42.146862 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5b1b75-cdd9-4602-a07e-c4cab9e36158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:53:42.150271 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a8bc2f-737e-45a9-9a02-acd99c79dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:53:42.289696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a8bc2f-737e-45a9-9a02-acd99c79dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44834ab0-65a7-44b6-be11-74cf2eb5eca1', 'volume_name': 'volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f6f6828>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:53:42.293761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0f44b4-1ef6-42d6-82a8-855762dfa2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:53:42.296398 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0f44b4-1ef6-42d6-82a8-855762dfa2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:53:42.300376 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5120cf57-91c7-483d-8926-6691f9d562dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:53:42.303574 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Volume 44834ab0-65a7-44b6-be11-74cf2eb5eca1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f6f6828>}
Jan 25 12:53:42.306615 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Cloning 44834ab0-65a7-44b6-be11-74cf2eb5eca1 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 12:54:00.580242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 18.27 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 12:54:00.580242 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Image download 616.00 MB at 33.72 MB/s
Jan 25 12:54:00.630681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:00.762421 n-d-760454-3 sudo[103280]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1
Jan 25 12:54:00.763061 n-d-760454-3 sudo[103280]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:01.378130 n-d-760454-3 sudo[103280]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:01.380633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1" returned: 0 in 0.750s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:01.381862 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user b985b2f119474fb9898b38d54c64e610. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 12:54:01.480455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:01.581341 n-d-760454-3 sudo[103284]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1
Jan 25 12:54:01.581879 n-d-760454-3 sudo[103284]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:02.010893 n-d-760454-3 sudo[103284]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:02.014240 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1" returned: 0 in 0.534s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:02.017341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:02.043252 n-d-760454-3 sudo[103288]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:54:02.044104 n-d-760454-3 sudo[103288]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:02.769499 n-d-760454-3 sudo[103288]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:02.776899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.759s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:02.902428 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 44834ab0-65a7-44b6-be11-74cf2eb5eca1. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 12:54:02.974154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpdzywb7md {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:03.121335 n-d-760454-3 sudo[103321]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpdzywb7md
Jan 25 12:54:03.122127 n-d-760454-3 sudo[103321]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:03.491446 n-d-760454-3 sudo[103321]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:03.494542 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpdzywb7md" returned: 0 in 0.520s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:03.495869 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:03.665390 n-d-760454-3 sudo[103324]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1
Jan 25 12:54:03.666118 n-d-760454-3 sudo[103324]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:04.031117 n-d-760454-3 sudo[103324]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:04.033424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1" returned: 0 in 0.537s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:04.034884 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 12:54:04.035265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:04.051793 n-d-760454-3 sudo[103328]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1 oflag=direct
Jan 25 12:54:04.052336 n-d-760454-3 sudo[103328]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:04.478768 n-d-760454-3 sudo[103328]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:04.482572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1 oflag=direct" returned: 0 in 0.446s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:04.486039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:04.506420 n-d-760454-3 sudo[103338]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1
Jan 25 12:54:04.506978 n-d-760454-3 sudo[103338]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:23.520187 n-d-760454-3 sudo[103338]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:23.524095 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1" returned: 0 in 19.039s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:23.526523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:23.636664 n-d-760454-3 sudo[103433]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1
Jan 25 12:54:23.637187 n-d-760454-3 sudo[103433]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:24.030465 n-d-760454-3 sudo[103433]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:24.032742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1" returned: 0 in 0.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:24.033906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpqyz5r1lxn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 19.04 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--44834ab0--65a7--44b6--be11--74cf2eb5eca1 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 12:54:24.034632 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Converted 700.00 MB image at 36.76 MB/s
Jan 25 12:54:24.035476 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 44834ab0-65a7-44b6-be11-74cf2eb5eca1 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 12:54:24.208803 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user b985b2f119474fb9898b38d54c64e610 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 12:54:24.210625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Marking volume 44834ab0-65a7-44b6-be11-74cf2eb5eca1 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 12:54:24.250722 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 44834ab0-65a7-44b6-be11-74cf2eb5eca1. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 12:54:24.251256 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Creating volume glance metadata for volume 44834ab0-65a7-44b6-be11-74cf2eb5eca1 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 12:54:24.413073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5120cf57-91c7-483d-8926-6691f9d562dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f6f6828>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:24.416680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0793ccfa-7d88-41ee-aa2a-b1781af2d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:24.462041 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Volume volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 (44834ab0-65a7-44b6-be11-74cf2eb5eca1): created successfully
Jan 25 12:54:24.464250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0793ccfa-7d88-41ee-aa2a-b1781af2d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:24.467790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (2566c757-ec7d-46b9-aa70-4281d70df14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:24.547628 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-58ca55cb-dab4-4db7-bba7-a3bd54476993 tempest-TaggedBootDevicesTest-591027464 None] Created volume successfully.
Jan 25 12:54:25.794394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:54:25.799030 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:54:25.799900 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:54:25.816008 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (32be31d8-89b5-4703-885c-0c5e627739fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:25.819479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ed0d5b-a32a-41d9-8b3f-ad8ca2b50989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:25.848227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:54:25.876424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ed0d5b-a32a-41d9-8b3f-ad8ca2b50989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-740987252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=32f3a42f-60d4-42f6-b71d-10d5cc647069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1616cd8259b845a0a028b709078c24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:54:26Z,user_id='b985b2f119474fb9898b38d54c64e610',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:25.879534 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f24786a-71dc-4b17-901c-ab9646af5f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:25.882008 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f24786a-71dc-4b17-901c-ab9646af5f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:25.884914 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bf1715-6352-46dc-a744-a69b87680896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:25.888446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bf1715-6352-46dc-a744-a69b87680896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f3a42f-60d4-42f6-b71d-10d5cc647069', 'volume_name': 'volume-32f3a42f-60d4-42f6-b71d-10d5cc647069', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:25.891061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff565db-e9d0-4e9c-86df-3e572d53a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:25.894212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff565db-e9d0-4e9c-86df-3e572d53a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:25.896900 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d85d59-9dd4-48c2-b3f8-f198c32e273a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:25.898612 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Volume 32f3a42f-60d4-42f6-b71d-10d5cc647069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f3a42f-60d4-42f6-b71d-10d5cc647069', 'volume_size': 1}
Jan 25 12:54:25.900029 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:25.933055 n-d-760454-3 sudo[103450]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:54:25.934006 n-d-760454-3 sudo[103450]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:26.631610 n-d-760454-3 sudo[103450]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:26.634025 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.733s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:26.638228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d85d59-9dd4-48c2-b3f8-f198c32e273a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f3a42f-60d4-42f6-b71d-10d5cc647069', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:26.641692 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec31a4c-1db9-42a7-9e7d-85424a22d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:26.690784 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Volume volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 (32f3a42f-60d4-42f6-b71d-10d5cc647069): created successfully
Jan 25 12:54:26.693650 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec31a4c-1db9-42a7-9e7d-85424a22d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:26.697042 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (32be31d8-89b5-4703-885c-0c5e627739fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:26.735690 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3a2ab2c1-bab9-4047-b238-227fe1ddb2ca tempest-TaggedBootDevicesTest-591027464 None] Created volume successfully.
Jan 25 12:54:27.726405 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:54:27.732063 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:54:27.732644 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:54:27.748244 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (be96aaaa-5201-46d2-9cc3-1f984ea0aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:27.752013 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe565445-62c5-4d40-8575-7f5c8a6378d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:27.777329 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:54:27.806798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe565445-62c5-4d40-8575-7f5c8a6378d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-59506478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=1c0adaab-ad3f-42e8-9275-0dcd74d93f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1616cd8259b845a0a028b709078c24b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:54:28Z,user_id='b985b2f119474fb9898b38d54c64e610',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:27.810696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327a28f-eae9-40e5-bd2b-669b8776db23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:27.813298 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327a28f-eae9-40e5-bd2b-669b8776db23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:27.816079 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c67ae93-2a38-4283-91b1-25cff90997ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:27.818892 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c67ae93-2a38-4283-91b1-25cff90997ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0adaab-ad3f-42e8-9275-0dcd74d93f9a', 'volume_name': 'volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:27.822178 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c720f49-11f9-471d-9653-b03e52415fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:27.825440 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c720f49-11f9-471d-9653-b03e52415fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:27.827986 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e83389-0392-4d1d-864b-b29af55c2c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:27.829119 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Volume 1c0adaab-ad3f-42e8-9275-0dcd74d93f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a', 'volume_size': 1}
Jan 25 12:54:27.830499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:27.898934 n-d-760454-3 sudo[103479]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:54:27.899526 n-d-760454-3 sudo[103479]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:28.557173 n-d-760454-3 sudo[103479]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:28.565948 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.729s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:28.569930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e83389-0392-4d1d-864b-b29af55c2c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:28.572758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5919f-fd6f-4053-9a0c-0a07f013db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:28.633181 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Volume volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a (1c0adaab-ad3f-42e8-9275-0dcd74d93f9a): created successfully
Jan 25 12:54:28.635954 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5919f-fd6f-4053-9a0c-0a07f013db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:28.639703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Flow 'volume_create_manager' (be96aaaa-5201-46d2-9cc3-1f984ea0aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:28.696305 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8111ab97-c011-4f2a-be1f-48769d6ba16e tempest-TaggedBootDevicesTest-591027464 None] Created volume successfully.
Jan 25 12:54:35.819271 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:54:35.821420 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:54:35.822807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:35.853603 n-d-760454-3 sudo[103528]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:54:35.854220 n-d-760454-3 sudo[103528]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:36.357835 n-d-760454-3 sudo[103528]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:36.359886 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:36.361422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:36.387271 n-d-760454-3 sudo[103532]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:54:36.388404 n-d-760454-3 sudo[103532]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:37.120768 n-d-760454-3 sudo[103532]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:37.123879 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.762s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:37.127608 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:54:46.983713 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:54:46.990316 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:54:46.991298 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:54:47.007554 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Flow 'volume_create_manager' (4e99e398-9570-4996-9111-709511e2d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:47.023926 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4dd385-4449-40ed-b1d5-f4c452febe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:47.109457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:54:47.156394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4dd385-4449-40ed-b1d5-f4c452febe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1876874045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=a70dae17-594e-4e94-af78-0ec3acceabd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a46343d8a494c3db1f6be93b4a13681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:54:47Z,user_id='286e8bba260048fcafb37546f824d4e9',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:47.159487 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c84b7f-2116-474e-9c40-b9d82bfca1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:47.168733 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c84b7f-2116-474e-9c40-b9d82bfca1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:47.171896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa15583-a922-4ada-9e92-c727e37f99cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:47.181853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa15583-a922-4ada-9e92-c727e37f99cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70dae17-594e-4e94-af78-0ec3acceabd6', 'volume_name': 'volume-a70dae17-594e-4e94-af78-0ec3acceabd6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:47.187102 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48917731-6683-4a91-8cb0-331303be9d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:47.196728 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48917731-6683-4a91-8cb0-331303be9d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:47.201261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4373c6-8fdf-4b23-9fd8-453213328dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:47.202694 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Volume a70dae17-594e-4e94-af78-0ec3acceabd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70dae17-594e-4e94-af78-0ec3acceabd6', 'volume_size': 1}
Jan 25 12:54:47.204488 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a70dae17-594e-4e94-af78-0ec3acceabd6 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:47.223575 n-d-760454-3 sudo[103721]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a70dae17-594e-4e94-af78-0ec3acceabd6 stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:54:47.224288 n-d-760454-3 sudo[103721]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:47.925707 n-d-760454-3 sudo[103721]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:47.929045 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a70dae17-594e-4e94-af78-0ec3acceabd6 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.724s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:47.933727 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4373c6-8fdf-4b23-9fd8-453213328dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70dae17-594e-4e94-af78-0ec3acceabd6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:47.936139 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726f222-53e6-44ac-9097-9914a4228064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:54:48.016304 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Volume volume-a70dae17-594e-4e94-af78-0ec3acceabd6 (a70dae17-594e-4e94-af78-0ec3acceabd6): created successfully
Jan 25 12:54:48.019728 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b726f222-53e6-44ac-9097-9914a4228064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:54:48.025922 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Flow 'volume_create_manager' (4e99e398-9570-4996-9111-709511e2d113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:54:48.084405 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-42a1ce21-b8da-4614-ad42-53c2e46bd5e6 tempest-DeleteServersTestJSON-2045922336 None] Created volume successfully.
Jan 25 12:54:50.546936 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:50.568395 n-d-760454-3 sudo[103764]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 12:54:50.569551 n-d-760454-3 sudo[103764]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:54:51.080013 n-d-760454-3 sudo[103764]: pam_unix(sudo:session): session closed for user root
Jan 25 12:54:51.082450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6" returned: 0 in 0.535s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:51.136212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:51.143964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:51.144297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:54:51.145829 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:54:51.146754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Creating iscsi_target for Volume ID: volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Created volume path /opt/stack/data/cinder/volumes/volume-a70dae17-594e-4e94-af78-0ec3acceabd6,
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6>
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:     incominguser eLVAcYC4DG5rAcLSbfVf 92AKLX2sV3g7frhJ
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:54:51.243511 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:54:51.245611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:51.820440 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6" returned: 0 in 0.574s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:51.820962 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:54:51.821531 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:54:51.821996 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:54:51.825709 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:51.850662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.021s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:51.850662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n            Backing store flags: \n    Account information:\n        eLVAcYC4DG5rAcLSbfVf\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:54:51.850859 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:54:51.851733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:52.006241 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.159s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:52.006993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n            Backing store flags: \n    Account information:\n        eLVAcYC4DG5rAcLSbfVf\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:54:52.010677 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:54:52.103228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.094s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:54:52.103880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n            Backing store flags: \n    Account information:\n        eLVAcYC4DG5rAcLSbfVf\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:54:52.105167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:54:52.450511 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-293b6636-9dc9-4534-a06d-7d4714293d46 req-88bc67d2-dd69-4561-9c42-21c808575c84 tempest-DeleteServersTestJSON-2045922336 None] attachment_update completed successfully.
Jan 25 12:55:05.165483 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-e443f8ea-9d87-4722-b5a3-1ff5c51a73b8 req-663ba579-6a2b-48e7-a361-1e9e0a11b324 tempest-DeleteServersTestJSON-2045922336 None] Terminate volume connection completed successfully.
Jan 25 12:55:05.166037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-e443f8ea-9d87-4722-b5a3-1ff5c51a73b8 req-663ba579-6a2b-48e7-a361-1e9e0a11b324 tempest-DeleteServersTestJSON-2045922336 None] Deleting attachment e70945a7-9464-4c80-b42a-e5f3b0483dd9. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 12:55:05.169239 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:05.347577 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.180s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:05.347937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6\n            Backing store flags: \n    Account information:\n        eLVAcYC4DG5rAcLSbfVf\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:05.348748 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-e443f8ea-9d87-4722-b5a3-1ff5c51a73b8 req-663ba579-6a2b-48e7-a361-1e9e0a11b324 tempest-DeleteServersTestJSON-2045922336 None] Removing iscsi_target for Volume ID: a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 12:55:05.354508 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:05.505226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-a70dae17-594e-4e94-af78-0ec3acceabd6 -f" returned: 0 in 0.154s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:05.507518 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:05.511817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:05.619327 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.109s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:05.620017 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:05.746970 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-e443f8ea-9d87-4722-b5a3-1ff5c51a73b8 req-663ba579-6a2b-48e7-a361-1e9e0a11b324 tempest-DeleteServersTestJSON-2045922336 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 12:55:05.746970 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 12:55:05.746970 n-d-760454-3 cinder-volume[89138]: 
Jan 25 12:55:12.998628 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:13.041823 n-d-760454-3 sudo[103933]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:13.042370 n-d-760454-3 sudo[103933]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:55:13.512776 n-d-760454-3 sudo[103933]: pam_unix(sudo:session): session closed for user root
Jan 25 12:55:13.516829 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1" returned: 0 in 0.516s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:13.577248 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:13.583849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.017s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:13.584197 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:13.584901 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:55:13.585477 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Creating iscsi_target for Volume ID: volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Created volume path /opt/stack/data/cinder/volumes/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1,
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1>
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:     incominguser kLMLBWTfTHH7Poj95F8w wsTtLqFaAno7792q
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:55:13.672704 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:55:13.675395 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:14.405400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1" returned: 0 in 0.726s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:14.405400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:14.405400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:55:14.405400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:55:14.409479 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:14.418289 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.010s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:14.418888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:14.419715 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:55:14.420894 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:14.530184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.109s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:14.530563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:14.531945 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:14.764676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.232s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:14.765062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:14.766181 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:55:15.250794 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-efc24591-a6ce-4aac-b929-afa4dd53ceba tempest-TaggedBootDevicesTest-591027464 None] attachment_update completed successfully.
Jan 25 12:55:16.464054 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:16.484793 n-d-760454-3 sudo[104051]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:16.493228 n-d-760454-3 sudo[104051]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:55:17.085601 n-d-760454-3 sudo[104051]: pam_unix(sudo:session): session closed for user root
Jan 25 12:55:17.088359 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069" returned: 0 in 0.624s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:17.235608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:17.257570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.022s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:17.257970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:17.259282 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:55:17.262024 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Creating iscsi_target for Volume ID: volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Created volume path /opt/stack/data/cinder/volumes/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069,
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069>
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:     incominguser 2bdSNPg3EvyF8m52EKCd L75FKrVVDyKUKVZS
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:55:17.357057 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:55:17.361689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:18.391404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069" returned: 0 in 1.028s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:18.391404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:18.391404 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:55:18.391404 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:55:18.392694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:18.416008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.024s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:55:18.419915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:18.609578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.191s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:18.610053 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:18.611675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:18.732590 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:18.733269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:18.734704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:55:19.571095 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-45054d47-325e-43dd-bb54-fea13c87eceb tempest-TaggedBootDevicesTest-591027464 None] attachment_update completed successfully.
Jan 25 12:55:20.654952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:20.710307 n-d-760454-3 sudo[104149]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:55:20.710909 n-d-760454-3 sudo[104149]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:55:21.999042 n-d-760454-3 sudo[104149]: pam_unix(sudo:session): session closed for user root
Jan 25 12:55:22.001731 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a" returned: 0 in 1.347s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:22.086151 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:22.107472 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.024s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:22.107961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:22.108695 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:55:22.114267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Creating iscsi_target for Volume ID: volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Created volume path /opt/stack/data/cinder/volumes/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a,
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a>
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:     incominguser zaMPZgEJVrLGB7HGqxW4 ZrsHi5moK3HPPfHE
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:55:22.179665 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:55:22.182922 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:22.749480 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a" returned: 0 in 0.567s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:22.749995 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:22.750947 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:55:22.751587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:55:22.758075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:22.780187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.025s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:22.780592 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:55:22.781252 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:55:22.792683 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:22.916889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.125s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:22.917267 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:22.918625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:23.035901 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.117s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:23.037575 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:55:23.038988 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:55:23.422031 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b809c678-f392-4bc3-be6f-d2bd264a67f4 req-7d8be5f7-6598-4912-91ea-70fc94d37a02 tempest-TaggedBootDevicesTest-591027464 None] attachment_update completed successfully.
Jan 25 12:55:35.821966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:55:35.824233 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:55:35.825489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:35.871109 n-d-760454-3 sudo[104511]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:55:35.877287 n-d-760454-3 sudo[104511]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:55:36.443238 n-d-760454-3 sudo[104511]: pam_unix(sudo:session): session closed for user root
Jan 25 12:55:36.446060 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:36.447899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:55:36.484004 n-d-760454-3 sudo[104530]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:55:36.495443 n-d-760454-3 sudo[104530]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:55:37.231176 n-d-760454-3 sudo[104530]: pam_unix(sudo:session): session closed for user root
Jan 25 12:55:37.233519 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.786s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:55:37.235258 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:55:56.350207 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:55:56.357184 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:55:56.359003 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:55:56.384877 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Flow 'volume_create_manager' (ccc5811d-8be0-441f-9e5e-0aca21bf5e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:55:56.389072 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f234a-2d8a-4d8f-bf74-f914c1fa9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:55:56.421165 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:55:56.462627 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693f234a-2d8a-4d8f-bf74-f914c1fa9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1216465886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=a1b8b097-d97b-4cfe-9f14-cda85476378c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c4cbf0213a456983a1ff9cd0b038c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:55:56Z,user_id='4390caf29ef44ea89a6d9affd2259cf9',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:55:56.465601 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422de44c-1e6b-40eb-a787-db5a9d8862e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:55:56.468869 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422de44c-1e6b-40eb-a787-db5a9d8862e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:55:56.471768 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a136975-4ded-49c0-9365-11e59082ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:55:56.599115 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a136975-4ded-49c0-9365-11e59082ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1b8b097-d97b-4cfe-9f14-cda85476378c', 'volume_name': 'volume-a1b8b097-d97b-4cfe-9f14-cda85476378c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f523fd0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:55:56.601889 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc04eca-d0fa-48b6-8626-81e2aa45d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:55:56.604408 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc04eca-d0fa-48b6-8626-81e2aa45d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:55:56.606748 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a966d38-673d-40fd-8334-5d8634693b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:55:56.607649 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Volume a1b8b097-d97b-4cfe-9f14-cda85476378c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1b8b097-d97b-4cfe-9f14-cda85476378c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f523fd0>}
Jan 25 12:55:56.609073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Cloning a1b8b097-d97b-4cfe-9f14-cda85476378c from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 12:56:17.701805 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 21.09 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 12:56:17.713767 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Image download 616.00 MB at 29.21 MB/s
Jan 25 12:56:17.776428 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:18.045747 n-d-760454-3 sudo[104890]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1
Jan 25 12:56:18.056825 n-d-760454-3 sudo[104890]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:18.623849 n-d-760454-3 sudo[104890]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:18.626303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1" returned: 0 in 0.850s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:18.627360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 4390caf29ef44ea89a6d9affd2259cf9. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 12:56:18.758020 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:18.946528 n-d-760454-3 sudo[104894]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1
Jan 25 12:56:18.947141 n-d-760454-3 sudo[104894]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:19.687059 n-d-760454-3 sudo[104894]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:19.690927 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1" returned: 0 in 0.933s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:19.694907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a1b8b097-d97b-4cfe-9f14-cda85476378c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:19.727318 n-d-760454-3 sudo[104898]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a1b8b097-d97b-4cfe-9f14-cda85476378c stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:56:19.728322 n-d-760454-3 sudo[104898]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:20.792775 n-d-760454-3 sudo[104898]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:20.795481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a1b8b097-d97b-4cfe-9f14-cda85476378c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.101s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:20.917777 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume a1b8b097-d97b-4cfe-9f14-cda85476378c. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 12:56:21.016438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpnsez1jbv {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:21.183679 n-d-760454-3 sudo[104929]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpnsez1jbv
Jan 25 12:56:21.196633 n-d-760454-3 sudo[104929]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:21.811172 n-d-760454-3 sudo[104929]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:21.814361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpnsez1jbv" returned: 0 in 0.798s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:21.817049 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:22.094238 n-d-760454-3 sudo[104932]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1
Jan 25 12:56:22.095319 n-d-760454-3 sudo[104932]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:23.235455 n-d-760454-3 sudo[104932]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:23.240255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1" returned: 0 in 1.422s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:23.242481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 12:56:23.244341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:23.301472 n-d-760454-3 sudo[104938]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c oflag=direct
Jan 25 12:56:23.309595 n-d-760454-3 sudo[104938]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:23.825311 n-d-760454-3 sudo[104938]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:23.827768 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c oflag=direct" returned: 0 in 0.583s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:23.829592 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:23.854789 n-d-760454-3 sudo[104948]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c
Jan 25 12:56:23.855390 n-d-760454-3 sudo[104948]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:35.824417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:56:35.825020 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:56:35.825654 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:35.842203 n-d-760454-3 sudo[104971]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:56:35.843261 n-d-760454-3 sudo[104971]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:36.303316 n-d-760454-3 sudo[104971]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:36.305492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:36.307282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:36.328016 n-d-760454-3 sudo[104984]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:56:36.328709 n-d-760454-3 sudo[104984]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:37.563506 n-d-760454-3 sudo[104984]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:37.585226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.259s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:37.585226 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:56:45.622663 n-d-760454-3 sudo[104948]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:45.625668 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c" returned: 0 in 21.796s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:45.630238 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:45.790003 n-d-760454-3 sudo[105028]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1
Jan 25 12:56:45.790553 n-d-760454-3 sudo[105028]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:46.164967 n-d-760454-3 sudo[105028]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:46.167399 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1" returned: 0 in 0.537s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:46.168603 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpjb11er0yn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 21.80 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--a1b8b097--d97b--4cfe--9f14--cda85476378c {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 12:56:46.169105 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Converted 700.00 MB image at 32.11 MB/s
Jan 25 12:56:46.170136 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume a1b8b097-d97b-4cfe-9f14-cda85476378c successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 12:56:46.296766 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 4390caf29ef44ea89a6d9affd2259cf9 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 12:56:46.297493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Marking volume a1b8b097-d97b-4cfe-9f14-cda85476378c as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 12:56:46.339569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to a1b8b097-d97b-4cfe-9f14-cda85476378c. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 12:56:46.340326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Creating volume glance metadata for volume a1b8b097-d97b-4cfe-9f14-cda85476378c backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 12:56:46.583930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a966d38-673d-40fd-8334-5d8634693b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b8b097-d97b-4cfe-9f14-cda85476378c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f523fd0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:56:46.587622 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dc1246-ccb1-4917-bfd1-11d5c776534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:56:46.653735 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Volume volume-a1b8b097-d97b-4cfe-9f14-cda85476378c (a1b8b097-d97b-4cfe-9f14-cda85476378c): created successfully
Jan 25 12:56:46.658340 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dc1246-ccb1-4917-bfd1-11d5c776534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:56:46.659676 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Flow 'volume_create_manager' (ccc5811d-8be0-441f-9e5e-0aca21bf5e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:56:46.773607 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0eaf3483-26c0-40cd-8193-8892f9f8f086 tempest-ServersTestBootFromVolume-1173728308 None] Created volume successfully.
Jan 25 12:56:54.471767 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:54.493076 n-d-760454-3 sudo[105034]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 12:56:54.494216 n-d-760454-3 sudo[105034]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:56:55.048037 n-d-760454-3 sudo[105034]: pam_unix(sudo:session): session closed for user root
Jan 25 12:56:55.050452 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c" returned: 0 in 0.578s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:55.194560 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:55.216009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.022s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:55.217293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 8
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 9
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 10
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         zaMPZgEJVrLGB7HGqxW4
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.218218 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 12:56:55.241131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Creating iscsi_target for Volume ID: volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Created volume path /opt/stack/data/cinder/volumes/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c,
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c>
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:     incominguser HVmUbnSQt6Tk3huWE89Y AcmdJuJ6U8u6dzA5
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:     
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 12:56:55.300333 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 12:56:55.306354 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:55.831584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c" returned: 0 in 0.525s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:55.832144 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:56:55.832565 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 12:56:55.832976 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 12:56:55.838221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:55.848008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.012s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:55.848831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 8
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 9
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 10
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         zaMPZgEJVrLGB7HGqxW4
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 12:56:55.850128 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 12:56:55.880759 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:56.246368 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.368s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:56.247353 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:56:56.251075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:56:56.359022 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.109s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:56:56.359963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 12:56:56.362230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] Set provider_location to: 10.222.0.65:3260,4 iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 12:56:57.070718 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ddb3e019-b6e9-4de7-b3a1-402479b7c91e req-d937aad1-729f-4f59-87cf-fe57e8ed7441 tempest-ServersTestBootFromVolume-1173728308 None] attachment_update completed successfully.
Jan 25 12:57:35.829179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:57:35.829179 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:57:35.829179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:57:35.875607 n-d-760454-3 sudo[105205]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:57:35.876125 n-d-760454-3 sudo[105205]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:57:36.511876 n-d-760454-3 sudo[105205]: pam_unix(sudo:session): session closed for user root
Jan 25 12:57:36.514450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:57:36.515711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:57:36.533823 n-d-760454-3 sudo[105209]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:57:36.534336 n-d-760454-3 sudo[105209]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:57:37.697945 n-d-760454-3 sudo[105209]: pam_unix(sudo:session): session closed for user root
Jan 25 12:57:37.704519 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.184s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:57:37.704519 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:58:35.825025 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:58:35.826821 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:58:35.827824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:58:35.853380 n-d-760454-3 sudo[105445]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:58:35.854454 n-d-760454-3 sudo[105445]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:58:36.489039 n-d-760454-3 sudo[105445]: pam_unix(sudo:session): session closed for user root
Jan 25 12:58:36.494424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:58:36.494424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:58:36.514865 n-d-760454-3 sudo[105449]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:58:36.516498 n-d-760454-3 sudo[105449]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:58:38.002138 n-d-760454-3 sudo[105449]: pam_unix(sudo:session): session closed for user root
Jan 25 12:58:38.004652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.511s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:58:38.005666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 12:59:35.762990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 12:59:35.768896 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 12:59:35.769734 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 12:59:35.842118 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Flow 'volume_create_manager' (efc43c70-66e5-492f-8739-ea1b33a8fa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:59:35.856821 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d8f5a4-d8a6-49b0-a7e1-24e5c47dc1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:35.898611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 12:59:35.899207 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 12:59:35.900354 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:59:35.934132 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 12:59:35.984403 n-d-760454-3 sudo[105547]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 12:59:35.985106 n-d-760454-3 sudo[105547]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:59:36.020287 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d8f5a4-d8a6-49b0-a7e1-24e5c47dc1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T12:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1976998747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc2612904f94a7a97d0b738d317c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T12:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T12:59:36Z,user_id='dc63285b6f4440bda3e2d664e5985554',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:36.029833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff2de5c-50e5-49e5-a615-8e36dc5c4e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:36.040002 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff2de5c-50e5-49e5-a615-8e36dc5c4e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:36.049761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a540b-1637-48a4-9715-4142dabd58e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:36.052623 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a540b-1637-48a4-9715-4142dabd58e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc', 'volume_name': 'volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:36.076241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0609e5f-f22d-43f9-a08b-ab5a89cd65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:36.078441 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0609e5f-f22d-43f9-a08b-ab5a89cd65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:36.090381 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771e2663-d8fe-4fee-ae87-a268315e7779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:36.104948 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc', 'volume_size': 1}
Jan 25 12:59:36.104948 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:59:36.154415 n-d-760454-3 sudo[105549]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc stack-volumes-lvmdriver-1 -L 1g
Jan 25 12:59:36.159270 n-d-760454-3 sudo[105549]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:59:37.353659 n-d-760454-3 sudo[105549]: pam_unix(sudo:session): session closed for user root
Jan 25 12:59:37.356610 n-d-760454-3 sudo[105547]: pam_unix(sudo:session): session closed for user root
Jan 25 12:59:37.357364 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.253s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:59:37.362390 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771e2663-d8fe-4fee-ae87-a268315e7779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:37.371201 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b65fb4-c859-4c33-80c1-dea8e32f0dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 12:59:37.382361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.482s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:59:37.384303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 12:59:37.413443 n-d-760454-3 sudo[105578]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 12:59:37.414197 n-d-760454-3 sudo[105578]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 12:59:37.457798 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc (fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc): created successfully
Jan 25 12:59:37.462279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b65fb4-c859-4c33-80c1-dea8e32f0dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 12:59:37.466653 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Flow 'volume_create_manager' (efc43c70-66e5-492f-8739-ea1b33a8fa9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 12:59:37.547184 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c3f4ccbc-1951-4c66-8ccd-a96094d3db51 tempest-ServerRescueNegativeTestJSON-189664185 None] Created volume successfully.
Jan 25 12:59:38.590154 n-d-760454-3 sudo[105578]: pam_unix(sudo:session): session closed for user root
Jan 25 12:59:38.602738 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.208s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 12:59:38.602738 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:00:16.842403 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:00:16.849717 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:00:16.854502 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:00:16.871760 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Flow 'volume_create_manager' (15636eef-906d-4b3c-93f6-03ce620f8849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:00:16.876323 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560fedd-097a-4621-bcbb-acef8acbe210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:16.912442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:00:16.976446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e560fedd-097a-4621-bcbb-acef8acbe210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-677713411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c2339f06-8cf6-4205-8f12-2cbf1d75fcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc2612904f94a7a97d0b738d317c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:00:17Z,user_id='dc63285b6f4440bda3e2d664e5985554',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:16.986895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb0871d-3abf-4bf1-9a38-3d26e0ad5dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:16.996734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb0871d-3abf-4bf1-9a38-3d26e0ad5dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:17.000906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e7ff3-1c86-46cd-b6fb-1418d575ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:17.011582 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5e7ff3-1c86-46cd-b6fb-1418d575ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2339f06-8cf6-4205-8f12-2cbf1d75fcaa', 'volume_name': 'volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:17.011582 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ab75bd-1bfd-442d-918e-31e58658d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:17.013253 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ab75bd-1bfd-442d-918e-31e58658d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:17.016674 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45e3dbc-0257-4d10-891c-6b74bd0d1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:17.017202 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume c2339f06-8cf6-4205-8f12-2cbf1d75fcaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa', 'volume_size': 1}
Jan 25 13:00:17.019554 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:17.049870 n-d-760454-3 sudo[105594]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:00:17.050432 n-d-760454-3 sudo[105594]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:17.830692 n-d-760454-3 sudo[105594]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:17.832956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.813s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:17.836438 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45e3dbc-0257-4d10-891c-6b74bd0d1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:17.839265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e73df4a-e5de-4c78-a25d-235383fde581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:00:17.891095 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Volume volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa (c2339f06-8cf6-4205-8f12-2cbf1d75fcaa): created successfully
Jan 25 13:00:17.895548 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e73df4a-e5de-4c78-a25d-235383fde581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:00:17.903319 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Flow 'volume_create_manager' (15636eef-906d-4b3c-93f6-03ce620f8849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:00:18.019588 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6bebd667-e969-4bde-96d8-51c1c97691b9 tempest-ServerRescueNegativeTestJSON-189664185 None] Created volume successfully.
Jan 25 13:00:20.871618 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:20.928995 n-d-760454-3 sudo[105623]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:00:20.930267 n-d-760454-3 sudo[105623]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:21.438808 n-d-760454-3 sudo[105623]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:21.441379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa" returned: 0 in 0.569s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:21.503272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:21.508865 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:21.509448 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 8
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 9
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 10
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         zaMPZgEJVrLGB7HGqxW4
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 11
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         HVmUbnSQt6Tk3huWE89Y
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:21.510482 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:00:21.532112 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Creating iscsi_target for Volume ID: volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Created volume path /opt/stack/data/cinder/volumes/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa,
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa>
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:     incominguser J68S6E9Hu8RdYuuZyGkQ VYn4z4tDT2bEnRvG
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:00:21.643703 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:00:21.649385 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:22.200798 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa" returned: 0 in 0.554s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:22.201306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:22.201989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:00:22.202502 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:00:22.204108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:22.235499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.031s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:22.236017 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n            Backing store flags: \n    Account information:\n        J68S6E9Hu8RdYuuZyGkQ\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 8
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         kLMLBWTfTHH7Poj95F8w
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 9
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         2bdSNPg3EvyF8m52EKCd
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 10
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         zaMPZgEJVrLGB7HGqxW4
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 11
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         HVmUbnSQt6Tk3huWE89Y
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:00:22.237303 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:00:22.257541 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:22.357086 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.118s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:22.357737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n            Backing store flags: \n    Account information:\n        J68S6E9Hu8RdYuuZyGkQ\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:22.362153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:22.542041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.179s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:22.542041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n            Backing store flags: \n    Account information:\n        J68S6E9Hu8RdYuuZyGkQ\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:22.543292 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] Set provider_location to: 10.222.0.65:3260,5 iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:00:22.981840 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ff943db7-513c-4c60-a574-cf166c9c8520 req-814c2f19-e250-4bf5-bfcd-4983f1303148 tempest-ServerRescueNegativeTestJSON-189664185 None] attachment_update completed successfully.
Jan 25 13:00:35.901147 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:00:35.901710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:00:35.902281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:35.922276 n-d-760454-3 sudo[105695]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:00:35.923479 n-d-760454-3 sudo[105695]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:36.474965 n-d-760454-3 sudo[105695]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:36.482920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:36.486468 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:36.510118 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Lock "b'cinder-a70dae17-594e-4e94-af78-0ec3acceabd6-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:00:36.522315 n-d-760454-3 sudo[105699]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:00:36.522902 n-d-760454-3 sudo[105699]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:36.692252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:36.952860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.260s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:36.954166 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 12\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n            Backing store flags: \n    Account information:\n        J68S6E9Hu8RdYuuZyGkQ\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:00:36.955948 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Skipping remove_export. No iscsi_target is presently exported for volume: a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 13:00:36.957562 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:37.001840 n-d-760454-3 sudo[105703]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 13:00:37.003051 n-d-760454-3 sudo[105703]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:37.341992 n-d-760454-3 sudo[105699]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:37.350767 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.859s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:37.350767 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:00:37.784358 n-d-760454-3 sudo[105703]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:37.787171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6" returned: 0 in 0.829s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:37.789525 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:37.846646 n-d-760454-3 sudo[105709]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 13:00:37.847682 n-d-760454-3 sudo[105709]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:38.420732 n-d-760454-3 sudo[105709]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:38.424481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6" returned: 0 in 0.635s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:38.428940 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:38.471264 n-d-760454-3 sudo[105713]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 13:00:38.473226 n-d-760454-3 sudo[105713]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:39.206604 n-d-760454-3 sudo[105713]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:39.209130 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a70dae17-594e-4e94-af78-0ec3acceabd6" returned: 0 in 0.780s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:39.210549 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Successfully deleted volume: a70dae17-594e-4e94-af78-0ec3acceabd6
Jan 25 13:00:39.325134 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Created reservations ['4179d2f5-86af-4c54-9f93-8ae56b8d7d69', 'f11b9950-7ccf-4174-898a-fcd5bbb5e054', '38a628fb-295c-43be-b583-fdcd837bfa9a', '35bd40e4-ca82-40e8-81bf-1532bd540d5b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:00:39.329120 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:00:39.329120 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:00:39.329120 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:00:39.513440 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:00:39.515026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:39.535893 n-d-760454-3 sudo[105722]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:00:39.537144 n-d-760454-3 sudo[105722]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:40.050442 n-d-760454-3 sudo[105722]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:40.052987 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:40.055921 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:00:40.092465 n-d-760454-3 sudo[105726]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:00:40.098836 n-d-760454-3 sudo[105726]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:00:40.903474 n-d-760454-3 sudo[105726]: pam_unix(sudo:session): session closed for user root
Jan 25 13:00:40.906013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.850s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:00:40.908210 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:00:40.920274 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Deleted volume successfully.
Jan 25 13:00:40.979167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b4656593-2a27-47a0-a8cc-5530f0977c86 tempest-DeleteServersTestJSON-2045922336 None] Lock "b'cinder-a70dae17-594e-4e94-af78-0ec3acceabd6-delete_volume'" released by "delete_volume" :: held 4.469s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:01:06.360470 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b6642727-f372-4f6c-8115-ebc08a74a399 req-29531134-d9e8-47e4-bffe-152a3faaa14a tempest-ServerRescueNegativeTestJSON-189664185 None] Terminate volume connection completed successfully.
Jan 25 13:01:06.361033 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-b6642727-f372-4f6c-8115-ebc08a74a399 req-29531134-d9e8-47e4-bffe-152a3faaa14a tempest-ServerRescueNegativeTestJSON-189664185 None] Deleting attachment 02d3360a-7321-4568-8a14-e84ff861d224. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:01:06.368746 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:06.470244 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.106s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:06.470935 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa\n            Backing store flags: \n    Account information:\n        J68S6E9Hu8RdYuuZyGkQ\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:06.472016 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-b6642727-f372-4f6c-8115-ebc08a74a399 req-29531134-d9e8-47e4-bffe-152a3faaa14a tempest-ServerRescueNegativeTestJSON-189664185 None] Removing iscsi_target for Volume ID: c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:06.477112 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:06.611500 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa -f" returned: 0 in 0.137s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:06.611854 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:06.613105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:06.796268 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.182s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:06.796604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:06.966544 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-b6642727-f372-4f6c-8115-ebc08a74a399 req-29531134-d9e8-47e4-bffe-152a3faaa14a tempest-ServerRescueNegativeTestJSON-189664185 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:01:06.966544 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:01:06.966544 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:01:08.735868 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Lock "b'cinder-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:01:08.936284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:09.083441 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.154s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:09.083900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 11\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:09.084840 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Skipping remove_export. No iscsi_target is presently exported for volume: c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:09.086506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:09.142852 n-d-760454-3 sudo[105754]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:09.145703 n-d-760454-3 sudo[105754]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:10.210264 n-d-760454-3 sudo[105754]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:10.212717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa" returned: 0 in 1.125s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:10.214316 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:10.233688 n-d-760454-3 sudo[105768]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:10.234330 n-d-760454-3 sudo[105768]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:10.689470 n-d-760454-3 sudo[105768]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:10.691801 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa" returned: 0 in 0.477s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:10.694107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:10.714746 n-d-760454-3 sudo[105774]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:10.715604 n-d-760454-3 sudo[105774]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:11.527339 n-d-760454-3 sudo[105774]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:11.529516 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa" returned: 0 in 0.835s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:11.531435 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Successfully deleted volume: c2339f06-8cf6-4205-8f12-2cbf1d75fcaa
Jan 25 13:01:11.609865 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Created reservations ['1731cf4b-f268-415b-a07f-5ad49f523782', '4b80b039-e225-4244-8736-b53b2a192bb2', '87747d95-6572-4ae8-a986-eedf9d02fbf2', 'edf15806-0652-4620-8452-7f536e8d3573'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:01:11.613269 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:01:11.613269 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:01:11.613269 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:01:11.729207 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:01:11.730081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:11.750655 n-d-760454-3 sudo[105783]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:01:11.751752 n-d-760454-3 sudo[105783]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:12.281603 n-d-760454-3 sudo[105783]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:12.284230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:12.287013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:12.323323 n-d-760454-3 sudo[105797]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:01:12.324453 n-d-760454-3 sudo[105797]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:12.737073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Lock "b'cinder-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:01:12.922391 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Skipping remove_export. No iscsi_target is presently exported for volume: fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc
Jan 25 13:01:12.926205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:12.951565 n-d-760454-3 sudo[105799]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc
Jan 25 13:01:12.952658 n-d-760454-3 sudo[105799]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:13.374171 n-d-760454-3 sudo[105797]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:13.377206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.090s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:13.379213 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:01:13.395609 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Deleted volume successfully.
Jan 25 13:01:13.453315 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6c978763-221d-447f-bf05-de98176c0be1 tempest-ServerRescueNegativeTestJSON-189664185 None] Lock "b'cinder-c2339f06-8cf6-4205-8f12-2cbf1d75fcaa-delete_volume'" released by "delete_volume" :: held 4.718s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:01:13.734403 n-d-760454-3 sudo[105799]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:13.744232 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc" returned: 0 in 0.810s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:13.744232 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:13.754445 n-d-760454-3 sudo[105807]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc
Jan 25 13:01:13.754971 n-d-760454-3 sudo[105807]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:14.321265 n-d-760454-3 sudo[105807]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:14.323629 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc" returned: 0 in 0.586s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:14.327506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:14.378777 n-d-760454-3 sudo[105813]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc
Jan 25 13:01:14.382221 n-d-760454-3 sudo[105813]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:15.463684 n-d-760454-3 sudo[105813]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:15.466172 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc" returned: 0 in 1.139s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:15.468210 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Successfully deleted volume: fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc
Jan 25 13:01:15.618261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Created reservations ['7e47c25c-0614-42d3-baa7-26d29a23b603', '351ee73b-82d3-464a-8eb7-b8e63ce6484a', '853634c5-ee56-482e-9dab-72f703965ef5', '93ae77e1-cddc-4514-9486-d7c7f664d754'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:01:15.621921 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:01:15.621921 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:01:15.621921 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:01:15.758079 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:01:15.758963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:15.787645 n-d-760454-3 sudo[105830]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:01:15.799255 n-d-760454-3 sudo[105830]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:16.640039 n-d-760454-3 sudo[105830]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:16.643013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.883s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:16.646300 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:16.667544 n-d-760454-3 sudo[105834]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:01:16.668908 n-d-760454-3 sudo[105834]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:17.468393 n-d-760454-3 sudo[105834]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:17.472480 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:17.476010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:01:17.503966 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Deleted volume successfully.
Jan 25 13:01:17.601617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-81c93500-3e21-4286-a217-923f8b378554 tempest-ServerRescueNegativeTestJSON-189664185 None] Lock "b'cinder-fb3ac7e0-fe11-486b-ba48-8a2b0412f3cc-delete_volume'" released by "delete_volume" :: held 4.861s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:01:20.278707 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-6b5f8751-410c-4b2e-93cf-b76866ecba0d tempest-ServersTestBootFromVolume-1173728308 None] Terminate volume connection completed successfully.
Jan 25 13:01:20.280257 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-6b5f8751-410c-4b2e-93cf-b76866ecba0d tempest-ServersTestBootFromVolume-1173728308 None] Deleting attachment e5cb4e43-7f29-440e-9bf2-2c442b05b53a. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:01:20.282619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:20.509333 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.227s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:20.509926 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c\n            Backing store flags: \n    Account information:\n        HVmUbnSQt6Tk3huWE89Y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:20.510981 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-6b5f8751-410c-4b2e-93cf-b76866ecba0d tempest-ServersTestBootFromVolume-1173728308 None] Removing iscsi_target for Volume ID: a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:20.515614 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:20.673990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-a1b8b097-d97b-4cfe-9f14-cda85476378c -f" returned: 0 in 0.160s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:20.674363 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:20.675637 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:20.915585 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.239s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:20.915983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:21.172738 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-6b5f8751-410c-4b2e-93cf-b76866ecba0d tempest-ServersTestBootFromVolume-1173728308 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:01:21.172738 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:01:21.172738 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:01:22.089963 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Lock "b'cinder-a1b8b097-d97b-4cfe-9f14-cda85476378c-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:01:22.419125 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:22.643505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.224s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:22.644115 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 8\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 9\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 10\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:01:22.645116 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Skipping remove_export. No iscsi_target is presently exported for volume: a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:22.646604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:22.703466 n-d-760454-3 sudo[105878]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:22.704057 n-d-760454-3 sudo[105878]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:24.136672 n-d-760454-3 sudo[105878]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:24.139752 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c" returned: 0 in 1.493s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:24.141557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:24.193275 n-d-760454-3 sudo[105886]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:24.200899 n-d-760454-3 sudo[105886]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:24.980433 n-d-760454-3 sudo[105886]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:24.983024 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c" returned: 0 in 0.841s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:24.985250 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:25.052579 n-d-760454-3 sudo[105890]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:25.053690 n-d-760454-3 sudo[105890]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:25.695826 n-d-760454-3 sudo[105890]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:25.705220 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a1b8b097-d97b-4cfe-9f14-cda85476378c" returned: 0 in 0.713s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:25.705220 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Successfully deleted volume: a1b8b097-d97b-4cfe-9f14-cda85476378c
Jan 25 13:01:25.892375 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Created reservations ['68705180-2be7-4542-9bf4-70650e527827', '32e6cb53-6fdd-4c8f-b2e7-66afd1f93bdd', '9cc9aad4-a039-492e-8bd5-3e9ce9b9ee3a', 'f4ee1569-9cf6-41b6-9350-b739632cea40'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:01:25.895282 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:01:25.895282 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:01:25.895282 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:01:26.140268 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:01:26.141365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:26.194680 n-d-760454-3 sudo[105899]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:01:26.195272 n-d-760454-3 sudo[105899]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:26.818198 n-d-760454-3 sudo[105899]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:26.821642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:26.825067 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:26.884579 n-d-760454-3 sudo[105903]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:01:26.887398 n-d-760454-3 sudo[105903]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:28.029760 n-d-760454-3 sudo[105903]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:28.033679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.207s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:28.035868 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:01:28.045216 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Deleted volume successfully.
Jan 25 13:01:28.154599 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-b94769fc-4b60-4539-bf4c-c2e72f523fd2 req-977e8531-01c9-4c15-9667-0e2032d244e1 tempest-ServersTestBootFromVolume-1173728308 None] Lock "b'cinder-a1b8b097-d97b-4cfe-9f14-cda85476378c-delete_volume'" released by "delete_volume" :: held 6.066s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:01:35.906561 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:01:35.907074 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:01:35.907715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:35.927852 n-d-760454-3 sudo[105931]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:01:35.929260 n-d-760454-3 sudo[105931]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:36.657900 n-d-760454-3 sudo[105931]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:36.660121 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:36.661607 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:01:36.707348 n-d-760454-3 sudo[105946]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:01:36.707899 n-d-760454-3 sudo[105946]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:01:37.564364 n-d-760454-3 sudo[105946]: pam_unix(sudo:session): session closed for user root
Jan 25 13:01:37.577971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.916s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:01:37.578825 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:02:35.909404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:02:35.910888 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:02:35.911228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:02:35.979626 n-d-760454-3 sudo[106704]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:02:35.980644 n-d-760454-3 sudo[106704]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:02:37.027933 n-d-760454-3 sudo[106704]: pam_unix(sudo:session): session closed for user root
Jan 25 13:02:37.038989 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.120s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:02:37.038989 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:02:37.065299 n-d-760454-3 sudo[106723]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:02:37.067020 n-d-760454-3 sudo[106723]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:02:38.393709 n-d-760454-3 sudo[106723]: pam_unix(sudo:session): session closed for user root
Jan 25 13:02:38.396397 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.363s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:02:38.397309 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:03:35.916388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:03:35.917228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:03:35.917366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:03:35.951608 n-d-760454-3 sudo[107337]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:03:35.952156 n-d-760454-3 sudo[107337]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:03:36.332844 n-d-760454-3 sudo[107337]: pam_unix(sudo:session): session closed for user root
Jan 25 13:03:36.353094 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:03:36.353094 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:03:36.355075 n-d-760454-3 sudo[107341]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:03:36.355890 n-d-760454-3 sudo[107341]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:03:36.971016 n-d-760454-3 sudo[107341]: pam_unix(sudo:session): session closed for user root
Jan 25 13:03:36.973328 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:03:36.974336 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:04:35.915521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:04:35.916520 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:04:35.917565 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:04:35.946901 n-d-760454-3 sudo[107635]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:04:35.947982 n-d-760454-3 sudo[107635]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:04:36.354504 n-d-760454-3 sudo[107635]: pam_unix(sudo:session): session closed for user root
Jan 25 13:04:36.356783 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:04:36.358092 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:04:36.397441 n-d-760454-3 sudo[107639]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:04:36.398026 n-d-760454-3 sudo[107639]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:04:37.316776 n-d-760454-3 sudo[107639]: pam_unix(sudo:session): session closed for user root
Jan 25 13:04:37.318939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.960s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:04:37.320045 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:05:20.588971 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:05:20.602443 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:05:20.603000 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:05:20.630395 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Flow 'volume_create_manager' (df0ebbe7-335f-49bd-b674-ac9c660d4873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:05:20.634195 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b43331-8c67-4820-a210-7ab778d259e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:20.662555 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:05:20.694048 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b43331-8c67-4820-a210-7ab778d259e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-80735606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=321507ac-e3fc-4dc3-9050-0da61246616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ea4055900e4a248d7b4a2282c79315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:05:20Z,user_id='3b44fc1d2a144e65921768611ee797dc',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:20.696992 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdc13e4-74ac-4959-a13e-ec9c69547925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:20.699932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdc13e4-74ac-4959-a13e-ec9c69547925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:20.704216 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1eebd3-3638-4fb4-adee-40f0b3b4a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:20.706990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1eebd3-3638-4fb4-adee-40f0b3b4a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321507ac-e3fc-4dc3-9050-0da61246616c', 'volume_name': 'volume-321507ac-e3fc-4dc3-9050-0da61246616c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:20.710064 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a147123-a12f-4d68-87a9-f48d24a97b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:20.712563 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a147123-a12f-4d68-87a9-f48d24a97b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:20.715014 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af036b1e-2fdc-4886-a7e5-f8804aa3e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:20.716094 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume 321507ac-e3fc-4dc3-9050-0da61246616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321507ac-e3fc-4dc3-9050-0da61246616c', 'volume_size': 1}
Jan 25 13:05:20.717439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-321507ac-e3fc-4dc3-9050-0da61246616c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:20.774005 n-d-760454-3 sudo[107912]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-321507ac-e3fc-4dc3-9050-0da61246616c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:05:20.777151 n-d-760454-3 sudo[107912]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:05:21.600727 n-d-760454-3 sudo[107912]: pam_unix(sudo:session): session closed for user root
Jan 25 13:05:21.602730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-321507ac-e3fc-4dc3-9050-0da61246616c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.885s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:21.606660 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af036b1e-2fdc-4886-a7e5-f8804aa3e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321507ac-e3fc-4dc3-9050-0da61246616c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:21.610112 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57403ae-8e12-468e-9c85-69cbe7f5e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:05:21.652260 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume volume-321507ac-e3fc-4dc3-9050-0da61246616c (321507ac-e3fc-4dc3-9050-0da61246616c): created successfully
Jan 25 13:05:21.655391 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57403ae-8e12-468e-9c85-69cbe7f5e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:05:21.660625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Flow 'volume_create_manager' (df0ebbe7-335f-49bd-b674-ac9c660d4873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:05:21.714920 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7c835b42-f403-4c9f-8eeb-0ec4adc99910 tempest-AttachVolumeShelveTestJSON-642976413 None] Created volume successfully.
Jan 25 13:05:35.916756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:05:35.917853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:05:35.918992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:35.971696 n-d-760454-3 sudo[108045]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:05:35.977685 n-d-760454-3 sudo[108045]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:05:36.425506 n-d-760454-3 sudo[108045]: pam_unix(sudo:session): session closed for user root
Jan 25 13:05:36.429301 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:36.431447 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:36.456162 n-d-760454-3 sudo[108049]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:05:36.457277 n-d-760454-3 sudo[108049]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:05:37.205375 n-d-760454-3 sudo[108049]: pam_unix(sudo:session): session closed for user root
Jan 25 13:05:37.207857 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.776s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:37.212297 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:05:48.331110 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-05699fc7-e558-4f57-af32-e971c8103803 tempest-TaggedBootDevicesTest-591027464 None] Terminate volume connection completed successfully.
Jan 25 13:05:48.331730 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-05699fc7-e558-4f57-af32-e971c8103803 tempest-TaggedBootDevicesTest-591027464 None] Deleting attachment 0cb9980c-ff24-43b6-a95a-c67571c51725. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:05:48.341411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:48.650251 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.316s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:48.650645 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1\n            Backing store flags: \n    Account information:\n        kLMLBWTfTHH7Poj95F8w\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:48.651354 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-05699fc7-e558-4f57-af32-e971c8103803 tempest-TaggedBootDevicesTest-591027464 None] Removing iscsi_target for Volume ID: 44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:05:48.655078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:48.814545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 -f" returned: 0 in 0.162s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:48.814899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:48.819863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:49.040442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.223s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:49.041037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:49.284548 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-05699fc7-e558-4f57-af32-e971c8103803 tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:05:49.284548 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:05:49.284548 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:05:49.748174 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-c39f4a15-a6b9-4961-b843-307c14c25ba7 tempest-TaggedBootDevicesTest-591027464 None] Terminate volume connection completed successfully.
Jan 25 13:05:49.751833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-c39f4a15-a6b9-4961-b843-307c14c25ba7 tempest-TaggedBootDevicesTest-591027464 None] Deleting attachment 2614c1fd-1b06-4916-abb8-8209ce4eda93. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:05:49.755648 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:50.038036 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.283s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:50.038338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069\n            Backing store flags: \n    Account information:\n        2bdSNPg3EvyF8m52EKCd\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:50.039281 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-c39f4a15-a6b9-4961-b843-307c14c25ba7 tempest-TaggedBootDevicesTest-591027464 None] Removing iscsi_target for Volume ID: 32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:05:50.041301 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:50.313953 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 -f" returned: 0 in 0.272s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:50.314268 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:50.321795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:50.538539 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.222s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:50.539124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:50.786096 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-c39f4a15-a6b9-4961-b843-307c14c25ba7 tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:05:50.786096 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:05:50.786096 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:05:51.207712 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-2cf17c80-de5f-402e-906c-cba7464c44ac tempest-TaggedBootDevicesTest-591027464 None] Terminate volume connection completed successfully.
Jan 25 13:05:51.208180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-2cf17c80-de5f-402e-906c-cba7464c44ac tempest-TaggedBootDevicesTest-591027464 None] Deleting attachment bc7c1be4-1822-4342-8f1c-3b01a3a7d993. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:05:51.216521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:51.556668 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.342s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:51.557044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a\n            Backing store flags: \n    Account information:\n        zaMPZgEJVrLGB7HGqxW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:51.557719 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-2cf17c80-de5f-402e-906c-cba7464c44ac tempest-TaggedBootDevicesTest-591027464 None] Removing iscsi_target for Volume ID: 1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:05:51.561107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:51.846537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a -f" returned: 0 in 0.287s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:51.847698 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:51.851053 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:05:52.120606 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.270s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:05:52.121745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:05:52.369489 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-18034617-f5bd-4290-84dc-ce5287551bf1 req-2cf17c80-de5f-402e-906c-cba7464c44ac tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:05:52.369489 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:05:52.369489 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:06:05.726702 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:06:05.731301 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:06:05.732445 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:06:05.765951 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (875921c8-b5ee-4510-99d8-51234b59ed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:06:05.773156 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf2c3e2-9f0a-4b7f-8c40-fd44a926e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:05.835906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:06:05.881209 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf2c3e2-9f0a-4b7f-8c40-fd44a926e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1794770706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=fa90bb0b-3610-41d3-9d45-e2579eb19bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a33ab25e364029b4c4ea0ed6ee67b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:06:06Z,user_id='4571425d34834e9d985bfeb7b23c178e',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:05.891312 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9a45a7-10fb-4c0e-a25c-2ed5a33f9bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:05.900170 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9a45a7-10fb-4c0e-a25c-2ed5a33f9bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:05.903614 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edde9bf6-b35f-4a4e-be7c-d92e84ff0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:05.918966 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edde9bf6-b35f-4a4e-be7c-d92e84ff0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa90bb0b-3610-41d3-9d45-e2579eb19bba', 'volume_name': 'volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:05.921827 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a54dfd-6754-4d51-8b3a-e996a453aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:05.924351 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a54dfd-6754-4d51-8b3a-e996a453aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:05.929950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456a8c88-c1d4-4393-85bb-8f2dbda7fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:05.931150 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Volume fa90bb0b-3610-41d3-9d45-e2579eb19bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba', 'volume_size': 1}
Jan 25 13:06:05.937674 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:05.967887 n-d-760454-3 sudo[108368]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:06:05.968489 n-d-760454-3 sudo[108368]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:07.083491 n-d-760454-3 sudo[108368]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:07.086150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.148s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:07.093759 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456a8c88-c1d4-4393-85bb-8f2dbda7fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:07.096434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516b970e-d9b1-44ee-891d-fb05b6e7f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:06:07.177665 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Volume volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba (fa90bb0b-3610-41d3-9d45-e2579eb19bba): created successfully
Jan 25 13:06:07.180165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516b970e-d9b1-44ee-891d-fb05b6e7f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:06:07.183658 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (875921c8-b5ee-4510-99d8-51234b59ed99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:06:07.329431 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-38c31307-ad72-4214-8009-82da9ca69c7a tempest-AttachVolumeTestJSON-450288000 None] Created volume successfully.
Jan 25 13:06:10.023979 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:10.071486 n-d-760454-3 sudo[108432]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:10.074463 n-d-760454-3 sudo[108432]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:11.044304 n-d-760454-3 sudo[108432]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:11.047281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba" returned: 0 in 1.022s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:11.205476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:11.229090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.025s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:11.229734 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:11.230640 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:06:11.232044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Creating iscsi_target for Volume ID: volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Created volume path /opt/stack/data/cinder/volumes/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba,
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba>
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:     incominguser BMAB298KrMx9ACCJYh99 DdPRxgnQchJa2fCQ
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:06:11.411259 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:06:11.415206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:12.551222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba" returned: 0 in 1.137s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:12.551715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:12.552449 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:06:12.553046 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:06:12.556652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:12.575523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.020s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:12.575966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:12.576767 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:06:12.580717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:12.724996 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.146s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:12.725725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:12.730852 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:12.860659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.124s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:12.861061 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:12.862354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:06:13.510667 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-594284c3-8af3-42c9-9512-d9b1844c2aa0 req-39caa214-820c-42f1-ae5f-bdacf4820637 tempest-AttachVolumeTestJSON-450288000 None] attachment_update completed successfully.
Jan 25 13:06:22.997990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:06:23.168703 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:23.356576 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.191s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:23.359369 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:23.360258 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Skipping remove_export. No iscsi_target is presently exported for volume: 1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:06:23.362199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:23.423414 n-d-760454-3 sudo[108574]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:06:23.423974 n-d-760454-3 sudo[108574]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:24.183232 n-d-760454-3 sudo[108574]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:24.185625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a" returned: 0 in 0.823s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:24.188665 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:24.233562 n-d-760454-3 sudo[108580]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:06:24.238227 n-d-760454-3 sudo[108580]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:24.979625 n-d-760454-3 sudo[108580]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:24.983165 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a" returned: 0 in 0.794s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:24.985711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:25.008603 n-d-760454-3 sudo[108585]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:06:25.009823 n-d-760454-3 sudo[108585]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:25.600216 n-d-760454-3 sudo[108585]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:25.602756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a" returned: 0 in 0.617s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:25.604193 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Successfully deleted volume: 1c0adaab-ad3f-42e8-9275-0dcd74d93f9a
Jan 25 13:06:25.683673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Created reservations ['eb60fdb0-7bea-4262-8c4b-e9fc80e63092', 'a1c70b3e-0338-4cba-92d4-162ebd3a5af6', 'ce3d3c8f-cd8d-43f7-b09d-aa0f7301ae1d', '9b9d0a0d-49fe-4599-80f8-7b19fb6b6202'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:06:25.687432 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:06:25.687432 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:06:25.687432 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:06:25.831495 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:06:25.834305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:25.860377 n-d-760454-3 sudo[108596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:06:25.861792 n-d-760454-3 sudo[108596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:26.383653 n-d-760454-3 sudo[108596]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:26.387644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:26.390884 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:26.415552 n-d-760454-3 sudo[108600]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:06:26.417694 n-d-760454-3 sudo[108600]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:26.945073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-32f3a42f-60d4-42f6-b71d-10d5cc647069-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:06:27.072933 n-d-760454-3 sudo[108600]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:27.083272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:27.096323 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:06:27.109253 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Deleted volume successfully.
Jan 25 13:06:27.123184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:27.177991 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-78dd5dff-156e-4a2e-8f42-47b9b84e6bc0 tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-1c0adaab-ad3f-42e8-9275-0dcd74d93f9a-delete_volume'" released by "delete_volume" :: held 4.177s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:06:27.216049 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.095s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:27.217704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:27.218612 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Skipping remove_export. No iscsi_target is presently exported for volume: 32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:06:27.220076 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:27.241640 n-d-760454-3 sudo[108606]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:06:27.242731 n-d-760454-3 sudo[108606]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:28.177295 n-d-760454-3 sudo[108606]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:28.180886 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069" returned: 0 in 0.961s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:28.184975 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:28.209552 n-d-760454-3 sudo[108610]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:06:28.210980 n-d-760454-3 sudo[108610]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:28.847093 n-d-760454-3 sudo[108610]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:28.849872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:28.852081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:28.925170 n-d-760454-3 sudo[108633]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:06:28.926903 n-d-760454-3 sudo[108633]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:29.590937 n-d-760454-3 sudo[108633]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:29.594186 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32f3a42f-60d4-42f6-b71d-10d5cc647069" returned: 0 in 0.741s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:29.595841 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Successfully deleted volume: 32f3a42f-60d4-42f6-b71d-10d5cc647069
Jan 25 13:06:29.738144 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Created reservations ['0e28fb67-eb16-49e6-831d-cb21fa8e05b7', 'd2c52742-206c-47aa-b9d1-2aa8568e2eca', 'd534f95b-5ca8-4538-afbb-ede5d03cea36', '32a73e35-cf0b-4f1c-b901-ae469c47f5f2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:06:29.741788 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:06:29.741788 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:06:29.741788 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:06:29.889099 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:06:29.889910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:29.933218 n-d-760454-3 sudo[108664]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:06:29.937199 n-d-760454-3 sudo[108664]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:30.366188 n-d-760454-3 sudo[108664]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:30.368700 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:30.371138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:30.390250 n-d-760454-3 sudo[108680]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:06:30.391390 n-d-760454-3 sudo[108680]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:30.971218 n-d-760454-3 sudo[108680]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:30.973716 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:30.975266 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:06:30.981154 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Deleted volume successfully.
Jan 25 13:06:31.047647 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-44834ab0-65a7-44b6-be11-74cf2eb5eca1-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:06:31.068435 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-40b6081c-b464-4e57-93ea-0960693881a1 tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-32f3a42f-60d4-42f6-b71d-10d5cc647069-delete_volume'" released by "delete_volume" :: held 4.124s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:06:31.226389 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:31.381735 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.158s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:31.383008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:31.383750 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Skipping remove_export. No iscsi_target is presently exported for volume: 44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:06:31.384786 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:31.419746 n-d-760454-3 sudo[108704]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:06:31.420383 n-d-760454-3 sudo[108704]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:32.159992 n-d-760454-3 sudo[108704]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:32.162584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1" returned: 0 in 0.778s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:32.164288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:32.182066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:32.192869 n-d-760454-3 sudo[108720]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:06:32.194018 n-d-760454-3 sudo[108720]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:32.249111 n-d-760454-3 sudo[108721]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:06:32.249944 n-d-760454-3 sudo[108721]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:32.894837 n-d-760454-3 sudo[108720]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:32.897245 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1" returned: 0 in 0.732s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:32.899615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:32.942630 n-d-760454-3 sudo[108740]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:06:32.957387 n-d-760454-3 sudo[108740]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:33.023021 n-d-760454-3 sudo[108721]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:33.025469 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c" returned: 0 in 0.843s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:33.156916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:33.168756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.018s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:33.169684 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 13
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         BMAB298KrMx9ACCJYh99
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:06:33.170553 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:06:33.176340 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Creating iscsi_target for Volume ID: volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Created volume path /opt/stack/data/cinder/volumes/volume-321507ac-e3fc-4dc3-9050-0da61246616c,
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c>
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:     incominguser QcjfU6SuRngRXV4k4n7g Wt8h36NpMbbuDJw2
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:06:33.261253 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:06:33.263945 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:33.730306 n-d-760454-3 sudo[108740]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:33.732177 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44834ab0-65a7-44b6-be11-74cf2eb5eca1" returned: 0 in 0.833s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:33.733270 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Successfully deleted volume: 44834ab0-65a7-44b6-be11-74cf2eb5eca1
Jan 25 13:06:33.892078 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Created reservations ['da0705e9-5302-4974-9026-c5058a52d27f', 'aa76212c-8e76-4492-b999-7da08e550920', 'd35b94b5-4949-4536-91d1-5e1617b55938', '1f3d3be2-5a11-4d27-8f21-2eebe4fbd2c7'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:06:33.894696 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:06:33.894696 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:06:33.894696 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:06:34.042406 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c" returned: 0 in 0.778s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:34.042903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:34.043944 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:06:34.044432 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:06:34.045998 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:06:34.049715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:34.064784 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:34.067150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:34.067742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 13
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         BMAB298KrMx9ACCJYh99
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:06:34.069131 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:06:34.072809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:34.087156 n-d-760454-3 sudo[108782]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:06:34.087838 n-d-760454-3 sudo[108782]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:34.228684 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.158s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:34.230357 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:34.234051 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:34.488462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.255s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:34.488898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:06:34.491159 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:06:34.648841 n-d-760454-3 sudo[108782]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:34.652858 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:34.654329 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:34.698509 n-d-760454-3 sudo[108790]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:06:34.705602 n-d-760454-3 sudo[108790]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:35.014025 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b5c80911-f60d-4bf9-a465-537ef57605bc req-5c712ddf-e235-4ecd-ae49-3e875222937e tempest-AttachVolumeShelveTestJSON-642976413 None] attachment_update completed successfully.
Jan 25 13:06:35.547696 n-d-760454-3 sudo[108790]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:35.550704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:35.554429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:06:35.561454 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Deleted volume successfully.
Jan 25 13:06:35.633966 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1aa3ca9e-b02c-4803-9e98-360f5e2d094d tempest-TaggedBootDevicesTest-591027464 None] Lock "b'cinder-44834ab0-65a7-44b6-be11-74cf2eb5eca1-delete_volume'" released by "delete_volume" :: held 4.583s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:06:35.921787 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:06:35.923241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:06:35.924688 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:35.991846 n-d-760454-3 sudo[108794]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:06:35.993078 n-d-760454-3 sudo[108794]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:36.509689 n-d-760454-3 sudo[108794]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:36.512664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:36.514822 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:06:36.542201 n-d-760454-3 sudo[108798]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:06:36.543720 n-d-760454-3 sudo[108798]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:06:37.498206 n-d-760454-3 sudo[108798]: pam_unix(sudo:session): session closed for user root
Jan 25 13:06:37.501690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.987s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:06:37.503416 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:07:13.398752 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:07:13.404838 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:07:13.405395 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:07:13.453298 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (40715154-fb9a-4151-bc64-f73f59775e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:07:13.457357 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c634e-dca6-4e8c-8349-138458182f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:13.493730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:07:13.527966 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8c634e-dca6-4e8c-8349-138458182f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1431624331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=784dddce-13d7-4bd9-bbe6-e20f6744b4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16c911c94e4a7f9466a3f1f98dfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:07:13Z,user_id='992d898613294ad4bc2c16f15cdeacfd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:13.531607 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080a6498-603b-4482-953d-355dc8ae94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:13.536036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080a6498-603b-4482-953d-355dc8ae94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:13.553434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98624d52-6bdf-4ca8-851e-e4393d1835ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:13.714603 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98624d52-6bdf-4ca8-851e-e4393d1835ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '784dddce-13d7-4bd9-bbe6-e20f6744b4a8', 'volume_name': 'volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c337c18>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:13.727307 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a7b324-ad52-4621-a4c4-a9303cd54336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:13.733586 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a7b324-ad52-4621-a4c4-a9303cd54336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:13.736030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54745c-d0de-4609-bb8a-eec995bb1859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:13.740590 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume 784dddce-13d7-4bd9-bbe6-e20f6744b4a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c337c18>}
Jan 25 13:07:13.741442 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Cloning 784dddce-13d7-4bd9-bbe6-e20f6744b4a8 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:07:31.995499 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 18.25 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:07:31.996274 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Image download 616.00 MB at 33.75 MB/s
Jan 25 13:07:32.044242 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:32.182513 n-d-760454-3 sudo[109512]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1
Jan 25 13:07:32.184990 n-d-760454-3 sudo[109512]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:32.796659 n-d-760454-3 sudo[109512]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:32.799741 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1" returned: 0 in 0.755s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:32.800739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 992d898613294ad4bc2c16f15cdeacfd. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:07:32.945187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:33.100315 n-d-760454-3 sudo[109517]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1
Jan 25 13:07:33.100909 n-d-760454-3 sudo[109517]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:33.352864 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:07:33.358075 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:07:33.358790 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:07:33.382704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (8c4a40ff-3846-43cc-8867-7833f59f6ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:07:33.387292 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01789a0-814e-42b0-8b5f-52fcd6a8a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:33.412951 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:07:33.457612 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01789a0-814e-42b0-8b5f-52fcd6a8a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2129455953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=e8d218e2-7e01-4bb3-915b-dcefdb760448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd73b8e7fd4735b19f1dfe299ded18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:07:33Z,user_id='03636c4ed43e4c3796d50463d2f184ee',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:33.461545 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c8c047-bf4a-491e-b014-8755efe33ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:33.464591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c8c047-bf4a-491e-b014-8755efe33ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:33.467035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43fa31-09b3-457f-b04f-909bc4629616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:33.469843 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad43fa31-09b3-457f-b04f-909bc4629616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d218e2-7e01-4bb3-915b-dcefdb760448', 'volume_name': 'volume-e8d218e2-7e01-4bb3-915b-dcefdb760448', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:33.472739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2a3c2-8e4a-450f-9709-481fda8f54aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:33.475091 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2a3c2-8e4a-450f-9709-481fda8f54aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:33.477375 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75afccb-7785-4b45-9e8a-4e2a7a9f900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:33.478353 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Volume e8d218e2-7e01-4bb3-915b-dcefdb760448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d218e2-7e01-4bb3-915b-dcefdb760448', 'volume_size': 1}
Jan 25 13:07:33.479434 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:33.497396 n-d-760454-3 sudo[109519]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:07:33.498550 n-d-760454-3 sudo[109519]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:33.597801 n-d-760454-3 sudo[109517]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:33.600450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1" returned: 0 in 0.655s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:33.602642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:33.622888 n-d-760454-3 sudo[109523]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:07:33.623436 n-d-760454-3 sudo[109523]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:34.177648 n-d-760454-3 sudo[109519]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:34.179838 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.700s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:34.183242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75afccb-7785-4b45-9e8a-4e2a7a9f900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d218e2-7e01-4bb3-915b-dcefdb760448', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:34.185765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cbc373-50e6-4024-a704-0a12fbacc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:07:34.267994 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Volume volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 (e8d218e2-7e01-4bb3-915b-dcefdb760448): created successfully
Jan 25 13:07:34.272961 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cbc373-50e6-4024-a704-0a12fbacc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:07:34.272961 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (8c4a40ff-3846-43cc-8867-7833f59f6ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:07:34.338819 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b96d9fdb-ec3a-4ce7-8f5d-b08b987b1a4e tempest-AttachVolumeNegativeTest-1889143894 None] Created volume successfully.
Jan 25 13:07:34.427788 n-d-760454-3 sudo[109523]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:34.429565 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.828s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:34.524932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 784dddce-13d7-4bd9-bbe6-e20f6744b4a8. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:07:34.587952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7bpnm8t6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:34.749094 n-d-760454-3 sudo[109585]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7bpnm8t6
Jan 25 13:07:34.749642 n-d-760454-3 sudo[109585]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:35.289812 n-d-760454-3 sudo[109585]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:35.292316 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7bpnm8t6" returned: 0 in 0.704s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:35.294003 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:35.412616 n-d-760454-3 sudo[109588]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1
Jan 25 13:07:35.413777 n-d-760454-3 sudo[109588]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:35.923200 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:07:35.924523 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:07:35.925613 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:35.963665 n-d-760454-3 sudo[109590]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:07:35.977227 n-d-760454-3 sudo[109590]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:35.983831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:36.037908 n-d-760454-3 sudo[109594]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:07:36.040169 n-d-760454-3 sudo[109594]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:36.043799 n-d-760454-3 sudo[109588]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:36.046774 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1" returned: 0 in 0.752s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:36.047722 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:07:36.049283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:36.088008 n-d-760454-3 sudo[109596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8 oflag=direct
Jan 25 13:07:36.088707 n-d-760454-3 sudo[109596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:36.577961 n-d-760454-3 sudo[109590]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:36.580404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:36.581950 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:36.615751 n-d-760454-3 sudo[109603]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:07:36.625505 n-d-760454-3 sudo[109603]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:36.704403 n-d-760454-3 sudo[109594]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:36.708034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448" returned: 0 in 0.723s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:36.860841 n-d-760454-3 sudo[109596]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:37.256375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8 oflag=direct" returned: 0 in 1.208s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:37.269079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:37.305547 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:37.306016 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.023s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:37.306535 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 13
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         BMAB298KrMx9ACCJYh99
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 14
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         QcjfU6SuRngRXV4k4n7g
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:07:37.307574 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:07:37.313967 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Creating iscsi_target for Volume ID: volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:07:37.317282 n-d-760454-3 sudo[109639]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8
Jan 25 13:07:37.321109 n-d-760454-3 sudo[109639]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Created volume path /opt/stack/data/cinder/volumes/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448,
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448>
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:     incominguser ywZZ4H2gav2RVtJE6bNX KgS7hJ5aQvmbbhB9
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:07:37.436345 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:07:37.444405 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:37.670093 n-d-760454-3 sudo[109603]: pam_unix(sudo:session): session closed for user root
Jan 25 13:07:37.674861 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.090s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:37.675995 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:07:37.996622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448" returned: 0 in 0.558s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:37.997599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:37.998817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:07:37.999429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:07:38.004464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.020s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 13
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         BMAB298KrMx9ACCJYh99
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 14
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         QcjfU6SuRngRXV4k4n7g
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:07:38.081646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:38.138959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.114s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:38.139358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:38.140713 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:38.261427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:38.262497 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 13\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:38.263852 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:07:38.971603 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-fb99b8a0-08c6-4665-a553-b22be3029f74 req-f47b1d97-ac08-4cce-8687-434cb4ca5e56 tempest-AttachVolumeNegativeTest-1889143894 None] attachment_update completed successfully.
Jan 25 13:07:42.221887 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-b858c713-484c-4259-82fe-058d60720c9f req-dbc03c14-254d-42ea-9923-458e0866add3 tempest-AttachVolumeTestJSON-450288000 None] Terminate volume connection completed successfully.
Jan 25 13:07:42.222660 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-b858c713-484c-4259-82fe-058d60720c9f req-dbc03c14-254d-42ea-9923-458e0866add3 tempest-AttachVolumeTestJSON-450288000 None] Deleting attachment d8e1a668-8e4b-4080-aa63-abd98e2020a6. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:07:42.224673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:42.316124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.085s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:42.316124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba\n            Backing store flags: \n    Account information:\n        BMAB298KrMx9ACCJYh99\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 15\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:42.316124 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-b858c713-484c-4259-82fe-058d60720c9f req-dbc03c14-254d-42ea-9923-458e0866add3 tempest-AttachVolumeTestJSON-450288000 None] Removing iscsi_target for Volume ID: fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:07:42.316124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:42.411412 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba -f" returned: 0 in 0.097s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:42.412302 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:42.415567 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:07:42.517476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.103s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:07:42.518321 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 14\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 15\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:07:42.920116 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-b858c713-484c-4259-82fe-058d60720c9f req-dbc03c14-254d-42ea-9923-458e0866add3 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:07:42.920116 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:07:42.920116 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:08:02.149132 n-d-760454-3 sudo[109639]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:02.151041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8" returned: 0 in 24.885s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:02.152652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:02.290185 n-d-760454-3 sudo[109862]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1
Jan 25 13:08:02.290854 n-d-760454-3 sudo[109862]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:02.725137 n-d-760454-3 sudo[109862]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:02.727421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1" returned: 0 in 0.574s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:02.728619 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmp4w3d8yrvn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 24.89 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--784dddce--13d7--4bd9--bbe6--e20f6744b4a8 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:08:02.729196 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Converted 700.00 MB image at 28.13 MB/s
Jan 25 13:08:02.729881 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 784dddce-13d7-4bd9-bbe6-e20f6744b4a8 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:08:02.854105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 992d898613294ad4bc2c16f15cdeacfd is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:08:02.855135 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Marking volume 784dddce-13d7-4bd9-bbe6-e20f6744b4a8 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:08:02.905187 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 784dddce-13d7-4bd9-bbe6-e20f6744b4a8. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:08:02.906141 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Creating volume glance metadata for volume 784dddce-13d7-4bd9-bbe6-e20f6744b4a8 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:08:03.116800 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f54745c-d0de-4609-bb8a-eec995bb1859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c337c18>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:03.122295 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4ce995-9116-4346-9d7f-7bd927ba3542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:03.159132 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 (784dddce-13d7-4bd9-bbe6-e20f6744b4a8): created successfully
Jan 25 13:08:03.161838 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4ce995-9116-4346-9d7f-7bd927ba3542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:03.165451 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (40715154-fb9a-4151-bc64-f73f59775e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:03.221371 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a97c01d8-0717-4702-9366-133558a033df tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume successfully.
Jan 25 13:08:04.698375 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:08:04.703551 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:08:04.704094 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:08:04.718581 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (55aea2d2-b441-4549-8d10-0152b5312510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:04.721877 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12388d53-ce17-4c26-8056-c174b9e1a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:04.745768 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:08:04.773541 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12388d53-ce17-4c26-8056-c174b9e1a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1129998746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=75dcbed8-429b-4bb0-8ac0-20d98326d7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16c911c94e4a7f9466a3f1f98dfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:08:05Z,user_id='992d898613294ad4bc2c16f15cdeacfd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:04.776218 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3b47c-d437-4ea3-a335-1f62b7a815d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:04.778468 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3b47c-d437-4ea3-a335-1f62b7a815d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:04.780879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d19186-7fef-405a-8fd0-10bd46ca3b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:04.783219 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d19186-7fef-405a-8fd0-10bd46ca3b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dcbed8-429b-4bb0-8ac0-20d98326d7a4', 'volume_name': 'volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:04.785541 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4ccc1d-0344-43a7-b10e-3f57a96a3875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:04.787690 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4ccc1d-0344-43a7-b10e-3f57a96a3875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:04.790009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0c5d18-eefd-4989-a72f-c1ba874b762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:04.790949 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume 75dcbed8-429b-4bb0-8ac0-20d98326d7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4', 'volume_size': 1}
Jan 25 13:08:04.791972 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:04.810066 n-d-760454-3 sudo[109870]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:08:04.810631 n-d-760454-3 sudo[109870]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:05.415893 n-d-760454-3 sudo[109870]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:05.418727 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.626s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:05.423406 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0c5d18-eefd-4989-a72f-c1ba874b762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:05.426958 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affc5806-e8a1-42e9-9a2d-3b978d91d2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:05.469905 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 (75dcbed8-429b-4bb0-8ac0-20d98326d7a4): created successfully
Jan 25 13:08:05.472513 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affc5806-e8a1-42e9-9a2d-3b978d91d2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:05.476769 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (55aea2d2-b441-4549-8d10-0152b5312510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:05.544323 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7ebae085-afad-4a9e-8b3f-d7870e440a00 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume successfully.
Jan 25 13:08:06.700666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:08:06.706213 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:08:06.707265 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:08:06.752243 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (16190663-5be4-48b7-af00-8d1bace5504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:06.752243 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c735d7-46eb-4a58-9442-77e81b509e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:06.795114 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:08:06.851813 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c735d7-46eb-4a58-9442-77e81b509e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1780259750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=0668b208-9770-4c5e-95db-0f55e2e9ac86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd16c911c94e4a7f9466a3f1f98dfdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:08:07Z,user_id='992d898613294ad4bc2c16f15cdeacfd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:06.862302 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d4cfcb-88c1-4326-bced-9c266feafcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:06.864479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d4cfcb-88c1-4326-bced-9c266feafcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:06.903037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e565ebd1-6791-4161-b536-8f473ac80ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:06.905040 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e565ebd1-6791-4161-b536-8f473ac80ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0668b208-9770-4c5e-95db-0f55e2e9ac86', 'volume_name': 'volume-0668b208-9770-4c5e-95db-0f55e2e9ac86', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:06.998662 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a34465-558d-4c10-8135-21dde2bd619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:06.998662 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a34465-558d-4c10-8135-21dde2bd619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:06.998662 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e7a0bd-6bd0-433d-a53a-6806ba892442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:06.998662 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume 0668b208-9770-4c5e-95db-0f55e2e9ac86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0668b208-9770-4c5e-95db-0f55e2e9ac86', 'volume_size': 1}
Jan 25 13:08:06.998662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:06.965345 n-d-760454-3 sudo[109904]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:08:06.978046 n-d-760454-3 sudo[109904]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:07.681612 n-d-760454-3 sudo[109904]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:07.683989 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.751s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:07.688181 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e7a0bd-6bd0-433d-a53a-6806ba892442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0668b208-9770-4c5e-95db-0f55e2e9ac86', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:07.691754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7253212-12fa-41e9-998c-5f6686ecaed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:07.738492 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Volume volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 (0668b208-9770-4c5e-95db-0f55e2e9ac86): created successfully
Jan 25 13:08:07.743612 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7253212-12fa-41e9-998c-5f6686ecaed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:07.747520 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Flow 'volume_create_manager' (16190663-5be4-48b7-af00-8d1bace5504c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:07.798429 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-64d4de4a-b793-48ad-92e5-99d05d2142d2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume successfully.
Jan 25 13:08:13.057328 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-5307c729-cac7-432f-a64e-17db0bb03d53 req-4a97a510-84e3-497e-9a50-8b2c32f1b8be tempest-AttachVolumeShelveTestJSON-642976413 None] Terminate volume connection completed successfully.
Jan 25 13:08:13.058367 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-5307c729-cac7-432f-a64e-17db0bb03d53 req-4a97a510-84e3-497e-9a50-8b2c32f1b8be tempest-AttachVolumeShelveTestJSON-642976413 None] Deleting attachment 983110d5-582c-4cf6-94a3-5057a639542b. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:08:13.064335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:13.175246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.114s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:13.176229 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c\n            Backing store flags: \n    Account information:\n        QcjfU6SuRngRXV4k4n7g\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 15\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:13.177572 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-5307c729-cac7-432f-a64e-17db0bb03d53 req-4a97a510-84e3-497e-9a50-8b2c32f1b8be tempest-AttachVolumeShelveTestJSON-642976413 None] Removing iscsi_target for Volume ID: 321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:08:13.180719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:13.289907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-321507ac-e3fc-4dc3-9050-0da61246616c -f" returned: 0 in 0.110s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:13.290230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:13.292942 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:13.393952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.102s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:13.394476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 15\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:13.526487 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-5307c729-cac7-432f-a64e-17db0bb03d53 req-4a97a510-84e3-497e-9a50-8b2c32f1b8be tempest-AttachVolumeShelveTestJSON-642976413 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:08:13.526487 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:08:13.526487 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:08:30.214380 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-4b444783-650c-4045-aa64-ba5bbbe13b07 req-520fe6a9-b2db-4d3c-a364-304fae51ba6a tempest-AttachVolumeNegativeTest-1889143894 None] Terminate volume connection completed successfully.
Jan 25 13:08:30.214923 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-4b444783-650c-4045-aa64-ba5bbbe13b07 req-520fe6a9-b2db-4d3c-a364-304fae51ba6a tempest-AttachVolumeNegativeTest-1889143894 None] Deleting attachment 0a12e851-4003-4baa-84ec-cd723f5d1b32. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:08:30.217714 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:30.378125 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.161s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:30.378714 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448\n            Backing store flags: \n    Account information:\n        ywZZ4H2gav2RVtJE6bNX\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:30.379555 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-4b444783-650c-4045-aa64-ba5bbbe13b07 req-520fe6a9-b2db-4d3c-a364-304fae51ba6a tempest-AttachVolumeNegativeTest-1889143894 None] Removing iscsi_target for Volume ID: e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:08:30.382785 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:30.599748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 -f" returned: 0 in 0.218s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:30.600102 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:30.604978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:30.712512 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.110s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:30.713103 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:30.953950 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-4b444783-650c-4045-aa64-ba5bbbe13b07 req-520fe6a9-b2db-4d3c-a364-304fae51ba6a tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:08:30.953950 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:08:30.953950 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:08:35.926881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:08:35.929010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:08:35.929995 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:35.966468 n-d-760454-3 sudo[110382]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:08:35.968305 n-d-760454-3 sudo[110382]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:36.452030 n-d-760454-3 sudo[110382]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:36.454120 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.524s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:36.457759 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:36.478274 n-d-760454-3 sudo[110387]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:08:36.479118 n-d-760454-3 sudo[110387]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:37.272747 n-d-760454-3 sudo[110387]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:37.274788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.819s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:37.276425 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:08:54.628141 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:08:54.638086 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:08:54.638730 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:08:54.670358 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (89ff420e-eec3-4828-9df7-d6eb8cae329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:54.681601 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291aab4a-9c71-475d-b330-6ec8a4bee5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:54.736905 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:08:54.774502 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291aab4a-9c71-475d-b330-6ec8a4bee5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-354428948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=846921de-7727-49ed-8998-d48033e7bcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd73b8e7fd4735b19f1dfe299ded18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:08:54Z,user_id='03636c4ed43e4c3796d50463d2f184ee',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:54.778370 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395e6f8-f1d2-4ffd-bfdd-2abaa335f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:54.782161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7395e6f8-f1d2-4ffd-bfdd-2abaa335f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:54.785169 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8981408c-b743-4b0b-a06f-dc70b2e8e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:54.788673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8981408c-b743-4b0b-a06f-dc70b2e8e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846921de-7727-49ed-8998-d48033e7bcd2', 'volume_name': 'volume-846921de-7727-49ed-8998-d48033e7bcd2', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:54.791371 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82c8f48-df61-4dd3-9e7d-fe4e6b1ac050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:54.803231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82c8f48-df61-4dd3-9e7d-fe4e6b1ac050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:54.806441 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b10fe7c-f36e-4fcb-ba14-1d96f898629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:54.807718 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Volume 846921de-7727-49ed-8998-d48033e7bcd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846921de-7727-49ed-8998-d48033e7bcd2', 'volume_size': 1}
Jan 25 13:08:54.809574 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-846921de-7727-49ed-8998-d48033e7bcd2 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:54.870140 n-d-760454-3 sudo[110558]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-846921de-7727-49ed-8998-d48033e7bcd2 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:08:54.872224 n-d-760454-3 sudo[110558]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:55.836180 n-d-760454-3 sudo[110558]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:55.839320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-846921de-7727-49ed-8998-d48033e7bcd2 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.029s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:55.842805 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b10fe7c-f36e-4fcb-ba14-1d96f898629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846921de-7727-49ed-8998-d48033e7bcd2', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:55.845708 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23de359-d88c-41d1-85af-2a8bc020ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:08:55.897940 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Volume volume-846921de-7727-49ed-8998-d48033e7bcd2 (846921de-7727-49ed-8998-d48033e7bcd2): created successfully
Jan 25 13:08:55.900258 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23de359-d88c-41d1-85af-2a8bc020ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:08:55.903997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (89ff420e-eec3-4828-9df7-d6eb8cae329e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:08:55.959820 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9a00204a-0e77-4126-9741-2ef4598afb55 tempest-AttachVolumeNegativeTest-1889143894 None] Created volume successfully.
Jan 25 13:08:56.139350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:56.190406 n-d-760454-3 sudo[110608]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:08:56.200908 n-d-760454-3 sudo[110608]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:56.774184 n-d-760454-3 sudo[110608]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:56.776743 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8" returned: 0 in 0.637s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:56.854727 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:56.902622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.046s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:56.902622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:56.903861 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:08:56.905106 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Creating iscsi_target for Volume ID: volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume path /opt/stack/data/cinder/volumes/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8,
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8>
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:     incominguser LC9eGp2bsRTmJUtzvHqt Q2ZRJeKgDs2Bni8A
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:08:56.999656 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:08:57.004115 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:57.743214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8" returned: 0 in 0.740s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:57.743534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:57.744164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:08:57.744618 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:08:57.754078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:57.781002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.034s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:57.781556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:57.782360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:08:57.783538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:57.944747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.160s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:57.946099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:57.948170 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:58.064261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.115s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:58.064932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:58.066157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:08:58.531760 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-ca05c5db-34c7-4034-a19b-41b8d341599b tempest-TaggedBootDevicesTest_v242-1532200539 None] attachment_update completed successfully.
Jan 25 13:08:59.055799 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:59.080411 n-d-760454-3 sudo[110663]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:08:59.082466 n-d-760454-3 sudo[110663]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:59.387793 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:59.406681 n-d-760454-3 sudo[110665]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:08:59.407738 n-d-760454-3 sudo[110665]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:08:59.682567 n-d-760454-3 sudo[110663]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:59.684991 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2" returned: 0 in 0.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:59.782978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:59.802574 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:59.802948 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:08:59.803650 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:08:59.806229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Creating iscsi_target for Volume ID: volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:08:59.876797 n-d-760454-3 sudo[110665]: pam_unix(sudo:session): session closed for user root
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Created volume path /opt/stack/data/cinder/volumes/volume-846921de-7727-49ed-8998-d48033e7bcd2,
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2>
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:     incominguser hLHV9zMd2HJ7FXM6acj6 BZU7qCJq5S8quVL7
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:08:59.906014 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:08:59.917180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4" returned: 0 in 0.524s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:08:59.961155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:08:59.993156 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:00.007746 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:00.009081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:00.010083 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:09:00.013652 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Creating iscsi_target for Volume ID: volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume path /opt/stack/data/cinder/volumes/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4,
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4>
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:     incominguser 8zNckbrCGhTWJsGMond2 n3iMAN6aoQ65EqwW
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:09:00.119213 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:09:00.125288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:00.706864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2" returned: 0 in 0.798s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:00.708083 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:00.709012 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:09:00.709591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:09:00.710985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:00.736024 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.024s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:00.736733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n    Account information:\n    ACL information:\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:00.737536 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:09:00.742415 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:00.802584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4" returned: 0 in 0.678s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:00.803164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:00.803933 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:09:00.804477 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:09:00.805880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:00.826298 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.020s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:00.826893 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:00.827742 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:09:00.834627 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:01.002081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.259s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:01.002657 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:01.004303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:01.089963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.256s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:01.091071 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:01.094375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:01.189671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.185s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:01.190660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:01.192549 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:09:01.283413 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.161s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:01.286143 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:01.298020 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:09:01.670021 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-98d0e22c-417a-42a7-a711-7e4c18884a12 req-df90a4ae-24a8-493b-ad9f-df5f4e93b90d tempest-AttachVolumeNegativeTest-1889143894 None] attachment_update completed successfully.
Jan 25 13:09:01.757603 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-d142ff8a-4095-46fe-b8a2-ddc6b1a85583 tempest-TaggedBootDevicesTest_v242-1532200539 None] attachment_update completed successfully.
Jan 25 13:09:02.788297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:02.841619 n-d-760454-3 sudo[110741]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:02.842877 n-d-760454-3 sudo[110741]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:09:03.554059 n-d-760454-3 sudo[110741]: pam_unix(sudo:session): session closed for user root
Jan 25 13:09:03.556824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86" returned: 0 in 0.768s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:03.634380 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:03.646107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.010s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:03.646712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 16\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 16
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         hLHV9zMd2HJ7FXM6acj6
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:03.647771 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:09:03.662340 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Creating iscsi_target for Volume ID: volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created volume path /opt/stack/data/cinder/volumes/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86,
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86>
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:     incominguser PC4aQRCMeCv6SKGVFHu4 yUS9XSQqAWC3K5j8
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:09:03.854153 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:09:03.857850 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:04.721312 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86" returned: 0 in 0.863s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:04.721912 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:04.722820 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:09:04.723341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:09:04.726789 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:04.753369 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.028s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 16\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 16
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         hLHV9zMd2HJ7FXM6acj6
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:04.754705 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:09:04.765131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:04.897675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.141s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:04.898251 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 16\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:04.899372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:05.114538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.215s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:05.115147 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 16\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:05.116451 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] Set provider_location to: 10.222.0.65:3260,4 iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:09:05.604887 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-08d760ec-ab38-4c99-803d-58fae5fbbea1 req-326e6880-1ae9-44ae-98ba-a4e5472bafb2 tempest-TaggedBootDevicesTest_v242-1532200539 None] attachment_update completed successfully.
Jan 25 13:09:09.836652 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-79d16cd6-35e1-46e8-9c28-34e7d2bc5d70 req-927495c0-faf6-440e-bb5d-5141a5370426 tempest-AttachVolumeNegativeTest-1889143894 None] Terminate volume connection completed successfully.
Jan 25 13:09:09.837172 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-79d16cd6-35e1-46e8-9c28-34e7d2bc5d70 req-927495c0-faf6-440e-bb5d-5141a5370426 tempest-AttachVolumeNegativeTest-1889143894 None] Deleting attachment a0e0ebed-ce0a-413a-82b6-101f36f44672. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:09:09.838760 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:09.947013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.108s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:09.947981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2\n            Backing store flags: \n    Account information:\n        hLHV9zMd2HJ7FXM6acj6\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:09.949086 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-79d16cd6-35e1-46e8-9c28-34e7d2bc5d70 req-927495c0-faf6-440e-bb5d-5141a5370426 tempest-AttachVolumeNegativeTest-1889143894 None] Removing iscsi_target for Volume ID: 846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:09:09.951194 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:10.060892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-846921de-7727-49ed-8998-d48033e7bcd2 -f" returned: 0 in 0.108s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:10.061509 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:10.072565 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:10.243961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.178s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:10.244628 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:10.383049 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-79d16cd6-35e1-46e8-9c28-34e7d2bc5d70 req-927495c0-faf6-440e-bb5d-5141a5370426 tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:09:10.383049 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:09:10.383049 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:09:35.929400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:09:35.930433 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:09:35.931648 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:35.966907 n-d-760454-3 sudo[111258]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:09:35.968903 n-d-760454-3 sudo[111258]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:09:36.672925 n-d-760454-3 sudo[111258]: pam_unix(sudo:session): session closed for user root
Jan 25 13:09:36.675695 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:36.677133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:36.719181 n-d-760454-3 sudo[111276]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:09:36.723014 n-d-760454-3 sudo[111276]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:09:37.411664 n-d-760454-3 sudo[111276]: pam_unix(sudo:session): session closed for user root
Jan 25 13:09:37.413788 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:37.415831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:09:43.435497 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:09:43.441254 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:09:43.441962 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:09:43.480188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (064476a7-9678-4ada-8fd1-f44ffa5fe50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:09:43.484509 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90998098-a4e9-4c72-958c-d92480bfece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:43.545400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:09:43.578055 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90998098-a4e9-4c72-958c-d92480bfece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1160185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=af149905-344c-4610-bbf8-70f12d499900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd73b8e7fd4735b19f1dfe299ded18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:09:43Z,user_id='03636c4ed43e4c3796d50463d2f184ee',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:43.581004 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989f00e8-59e2-4453-801a-03b3e648835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:43.583530 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989f00e8-59e2-4453-801a-03b3e648835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:43.586315 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e832dace-50a4-4a6c-beba-cd3dfd558c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:43.597338 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e832dace-50a4-4a6c-beba-cd3dfd558c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af149905-344c-4610-bbf8-70f12d499900', 'volume_name': 'volume-af149905-344c-4610-bbf8-70f12d499900', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:43.605913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7285e32-303d-437e-b913-1bb65fe13419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:43.605913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7285e32-303d-437e-b913-1bb65fe13419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:43.605913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406b7c18-8703-42c0-8acd-a784065a24ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:43.605913 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Volume af149905-344c-4610-bbf8-70f12d499900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af149905-344c-4610-bbf8-70f12d499900', 'volume_size': 1}
Jan 25 13:09:43.607298 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-af149905-344c-4610-bbf8-70f12d499900 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:43.624659 n-d-760454-3 sudo[111340]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-af149905-344c-4610-bbf8-70f12d499900 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:09:43.625201 n-d-760454-3 sudo[111340]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:09:44.354406 n-d-760454-3 sudo[111340]: pam_unix(sudo:session): session closed for user root
Jan 25 13:09:44.357018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-af149905-344c-4610-bbf8-70f12d499900 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.749s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:44.361144 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406b7c18-8703-42c0-8acd-a784065a24ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af149905-344c-4610-bbf8-70f12d499900', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:44.364388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199b94a2-0a4b-40b1-a271-36d240d1f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:09:44.421934 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Volume volume-af149905-344c-4610-bbf8-70f12d499900 (af149905-344c-4610-bbf8-70f12d499900): created successfully
Jan 25 13:09:44.425689 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199b94a2-0a4b-40b1-a271-36d240d1f244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:09:44.429233 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Flow 'volume_create_manager' (064476a7-9678-4ada-8fd1-f44ffa5fe50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:09:44.490783 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-777fef54-6ade-41f0-a5f2-e03a37d8f1ef tempest-AttachVolumeNegativeTest-1889143894 None] Created volume successfully.
Jan 25 13:09:46.467255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:46.499259 n-d-760454-3 sudo[111417]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:09:46.499814 n-d-760454-3 sudo[111417]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:09:47.182865 n-d-760454-3 sudo[111417]: pam_unix(sudo:session): session closed for user root
Jan 25 13:09:47.185514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900" returned: 0 in 0.720s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:47.285523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:47.289549 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.024s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:47.290124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:47.290998 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:09:47.305114 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Creating iscsi_target for Volume ID: volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Created volume path /opt/stack/data/cinder/volumes/volume-af149905-344c-4610-bbf8-70f12d499900,
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900>
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:     incominguser GKWzvADRcNJG8U5XTyW7 3pRG3Zq2VuXXb5FB
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:09:47.410031 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:09:47.413843 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:48.452422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900" returned: 0 in 1.037s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:48.453370 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:48.454501 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:09:48.455216 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:09:48.458608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:48.497210 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.036s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:48.497531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900\n            Backing store flags: \n    Account information:\n        GKWzvADRcNJG8U5XTyW7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:09:48.499308 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:09:48.511282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:48.791025 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.290s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:48.791415 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900\n            Backing store flags: \n    Account information:\n        GKWzvADRcNJG8U5XTyW7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:48.794604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:48.968237 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.175s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:48.968888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900\n            Backing store flags: \n    Account information:\n        GKWzvADRcNJG8U5XTyW7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:48.970219 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] Set provider_location to: 10.222.0.65:3260,5 iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:09:49.416778 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-527ff775-7bdc-47b6-a2bb-675710307e8a req-8e58db00-4cea-452e-b452-99ac63c0d4ac tempest-AttachVolumeNegativeTest-1889143894 None] attachment_update completed successfully.
Jan 25 13:09:58.287830 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-65fa6769-f578-46d6-b967-0d681d38673e req-403fbbac-88ce-4c94-baca-9e9a83c1c94d tempest-AttachVolumeNegativeTest-1889143894 None] Terminate volume connection completed successfully.
Jan 25 13:09:58.288494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-65fa6769-f578-46d6-b967-0d681d38673e req-403fbbac-88ce-4c94-baca-9e9a83c1c94d tempest-AttachVolumeNegativeTest-1889143894 None] Deleting attachment 09e1632a-065d-42b7-8db1-890fc98d1399. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:09:58.290005 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:58.377946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.087s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:58.378343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900\n            Backing store flags: \n    Account information:\n        GKWzvADRcNJG8U5XTyW7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:58.379083 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-65fa6769-f578-46d6-b967-0d681d38673e req-403fbbac-88ce-4c94-baca-9e9a83c1c94d tempest-AttachVolumeNegativeTest-1889143894 None] Removing iscsi_target for Volume ID: af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:09:58.383053 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:58.568485 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-af149905-344c-4610-bbf8-70f12d499900 -f" returned: 0 in 0.187s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:58.569421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:58.573073 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:09:58.704603 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.133s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:09:58.705338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:09:58.838785 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-65fa6769-f578-46d6-b967-0d681d38673e req-403fbbac-88ce-4c94-baca-9e9a83c1c94d tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:09:58.838785 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:09:58.838785 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:09:59.986356 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-af149905-344c-4610-bbf8-70f12d499900-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:10:00.162114 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:00.261335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.099s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:00.261853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:10:00.263117 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Skipping remove_export. No iscsi_target is presently exported for volume: af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:10:00.263834 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:00.294004 n-d-760454-3 sudo[111644]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:10:00.294724 n-d-760454-3 sudo[111644]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:00.872373 n-d-760454-3 sudo[111644]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:00.875071 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900" returned: 0 in 0.611s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:00.876605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:00.897627 n-d-760454-3 sudo[111648]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:10:00.898857 n-d-760454-3 sudo[111648]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:01.409797 n-d-760454-3 sudo[111648]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:01.412638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900" returned: 0 in 0.535s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:01.415773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:01.440302 n-d-760454-3 sudo[111652]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:10:01.449179 n-d-760454-3 sudo[111652]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:02.233872 n-d-760454-3 sudo[111652]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:02.236383 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-af149905-344c-4610-bbf8-70f12d499900" returned: 0 in 0.821s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:02.237844 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Successfully deleted volume: af149905-344c-4610-bbf8-70f12d499900
Jan 25 13:10:02.387400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Created reservations ['e2648fee-3686-4f79-9de7-983597e18571', '276d69a4-91bb-43f4-bbe3-50085005828c', '8a8f9190-2b18-4d22-babc-1163bbf97585', '2d9a175b-48e1-40f5-a593-970779a818a3'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:10:02.390053 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:10:02.390053 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:10:02.390053 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:10:02.622378 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:10:02.623174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:02.661684 n-d-760454-3 sudo[111666]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:10:02.663333 n-d-760454-3 sudo[111666]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:03.178328 n-d-760454-3 sudo[111666]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:03.181055 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.557s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:03.183763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:03.214959 n-d-760454-3 sudo[111676]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:10:03.216593 n-d-760454-3 sudo[111676]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:03.791594 n-d-760454-3 sudo[111676]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:03.795351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:03.796374 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:10:03.810601 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Deleted volume successfully.
Jan 25 13:10:03.867007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f1a2ef9e-6936-46c2-8782-d5d89ea768fd tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-af149905-344c-4610-bbf8-70f12d499900-delete_volume'" released by "delete_volume" :: held 3.877s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:10:13.478959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-846921de-7727-49ed-8998-d48033e7bcd2-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:10:13.634573 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:13.725857 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.094s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:13.726261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:10:13.727015 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Skipping remove_export. No iscsi_target is presently exported for volume: 846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:10:13.727882 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:13.745332 n-d-760454-3 sudo[111736]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:10:13.745999 n-d-760454-3 sudo[111736]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:14.335204 n-d-760454-3 sudo[111736]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:14.337678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2" returned: 0 in 0.609s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:14.339964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:14.375238 n-d-760454-3 sudo[111742]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:10:14.375844 n-d-760454-3 sudo[111742]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:14.807436 n-d-760454-3 sudo[111742]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:14.809697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2" returned: 0 in 0.469s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:14.811771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:14.831535 n-d-760454-3 sudo[111746]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:10:14.832935 n-d-760454-3 sudo[111746]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:15.371224 n-d-760454-3 sudo[111746]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:15.374486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-846921de-7727-49ed-8998-d48033e7bcd2" returned: 0 in 0.562s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:15.375788 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Successfully deleted volume: 846921de-7727-49ed-8998-d48033e7bcd2
Jan 25 13:10:15.453705 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Created reservations ['0e177a62-cf93-411e-9dfa-0f09171d00cd', '1466688d-84b9-42d4-a106-849286b148f4', '8ea5381b-8893-4c5a-8aad-4b83594a6528', 'a7df9822-5770-4505-924c-6c4265b6cce4'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:10:15.456846 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:10:15.456846 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:10:15.456846 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:10:15.585415 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:10:15.586230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:15.607777 n-d-760454-3 sudo[111755]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:10:15.608581 n-d-760454-3 sudo[111755]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:16.024827 n-d-760454-3 sudo[111755]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:16.041969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:16.041969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:16.046020 n-d-760454-3 sudo[111759]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:10:16.046597 n-d-760454-3 sudo[111759]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:16.635340 n-d-760454-3 sudo[111759]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:16.638439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:16.640335 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:10:16.652719 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Deleted volume successfully.
Jan 25 13:10:16.741837 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7333216e-23b9-4a2b-bf57-007708a679a0 tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-846921de-7727-49ed-8998-d48033e7bcd2-delete_volume'" released by "delete_volume" :: held 3.263s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:10:35.938638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:10:35.939709 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:10:35.942000 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:35.981040 n-d-760454-3 sudo[111892]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:10:35.982574 n-d-760454-3 sudo[111892]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:36.622955 n-d-760454-3 sudo[111892]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:36.626737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:36.649245 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:36.681025 n-d-760454-3 sudo[111918]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:10:36.682106 n-d-760454-3 sudo[111918]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:36.831122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-e8d218e2-7e01-4bb3-915b-dcefdb760448-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:10:37.010403 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:37.165408 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.157s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:37.166671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:10:37.167641 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Skipping remove_export. No iscsi_target is presently exported for volume: e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:10:37.168742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:37.194050 n-d-760454-3 sudo[111930]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:10:37.194832 n-d-760454-3 sudo[111930]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:37.448621 n-d-760454-3 sudo[111918]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:37.450725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.822s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:37.451836 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:10:37.940887 n-d-760454-3 sudo[111930]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:37.944149 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448" returned: 0 in 0.775s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:37.945495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:38.001989 n-d-760454-3 sudo[111949]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:10:38.007896 n-d-760454-3 sudo[111949]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:38.534289 n-d-760454-3 sudo[111949]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:38.537001 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448" returned: 0 in 0.591s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:38.539897 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:38.557790 n-d-760454-3 sudo[111960]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:10:38.559006 n-d-760454-3 sudo[111960]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:39.174697 n-d-760454-3 sudo[111960]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:39.179012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e8d218e2-7e01-4bb3-915b-dcefdb760448" returned: 0 in 0.639s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:39.180819 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Successfully deleted volume: e8d218e2-7e01-4bb3-915b-dcefdb760448
Jan 25 13:10:39.283747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Created reservations ['15e68664-7b21-47cd-8a42-c573a3fd3415', 'c7fc3800-17e7-4965-84d6-e600374040ec', 'a266aca1-f043-4198-97a6-6f4968e31d35', '11f7a269-c27d-4c63-9285-69b95be3141a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:10:39.287608 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:10:39.287608 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:10:39.287608 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:10:39.443511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:10:39.445099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:39.477545 n-d-760454-3 sudo[111972]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:10:39.478141 n-d-760454-3 sudo[111972]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:40.202368 n-d-760454-3 sudo[111972]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:40.204659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.760s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:40.206495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:10:40.228433 n-d-760454-3 sudo[112000]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:10:40.229648 n-d-760454-3 sudo[112000]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:10:41.099830 n-d-760454-3 sudo[112000]: pam_unix(sudo:session): session closed for user root
Jan 25 13:10:41.102065 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.895s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:10:41.106175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:10:41.113449 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Deleted volume successfully.
Jan 25 13:10:41.162695 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-881c97d7-0778-4bad-8ce8-a0a753d845e6 tempest-AttachVolumeNegativeTest-1889143894 None] Lock "b'cinder-e8d218e2-7e01-4bb3-915b-dcefdb760448-delete_volume'" released by "delete_volume" :: held 4.332s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:11:35.937572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:11:35.938195 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:11:35.938918 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:11:35.963501 n-d-760454-3 sudo[112628]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:11:35.964108 n-d-760454-3 sudo[112628]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:11:36.554177 n-d-760454-3 sudo[112628]: pam_unix(sudo:session): session closed for user root
Jan 25 13:11:36.561234 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:11:36.561234 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:11:36.596443 n-d-760454-3 sudo[112632]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:11:36.599670 n-d-760454-3 sudo[112632]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:11:37.844236 n-d-760454-3 sudo[112632]: pam_unix(sudo:session): session closed for user root
Jan 25 13:11:37.846686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.289s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:11:37.847752 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:12:18.947794 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:12:18.953008 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:12:18.953567 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:12:18.990960 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Flow 'volume_create_manager' (e6681341-eca0-4788-8983-49e5b60eb649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:12:18.997092 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a1b1a8-205a-4946-83c0-e8e8325ed81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:19.060298 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:12:19.112194 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a1b1a8-205a-4946-83c0-e8e8325ed81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1831042870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=ef40a4ec-ccd4-4f03-bb76-15756ce23cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ea4055900e4a248d7b4a2282c79315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:12:19Z,user_id='3b44fc1d2a144e65921768611ee797dc',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:19.119692 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72af7242-59ad-4439-bbbe-01b5063b9c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:19.130445 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72af7242-59ad-4439-bbbe-01b5063b9c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:19.136369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b261115-ba9e-4e57-b32f-a896795aa20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:19.138947 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b261115-ba9e-4e57-b32f-a896795aa20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef40a4ec-ccd4-4f03-bb76-15756ce23cf7', 'volume_name': 'volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:19.145525 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893cd7ad-7046-4406-bbb1-aafa4c99de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:19.147839 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893cd7ad-7046-4406-bbb1-aafa4c99de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:19.164921 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558f8391-0dc1-474a-83a0-e84f02574a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:19.166494 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume ef40a4ec-ccd4-4f03-bb76-15756ce23cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7', 'volume_size': 1}
Jan 25 13:12:19.167856 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:12:19.206484 n-d-760454-3 sudo[113119]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:12:19.207269 n-d-760454-3 sudo[113119]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:12:20.016935 n-d-760454-3 sudo[113119]: pam_unix(sudo:session): session closed for user root
Jan 25 13:12:20.019645 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.851s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:12:20.028910 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558f8391-0dc1-474a-83a0-e84f02574a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:20.033508 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b99125f-12a8-4be3-a1b6-5a51d5374abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:12:20.132913 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Volume volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 (ef40a4ec-ccd4-4f03-bb76-15756ce23cf7): created successfully
Jan 25 13:12:20.137456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b99125f-12a8-4be3-a1b6-5a51d5374abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:12:20.138283 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Flow 'volume_create_manager' (e6681341-eca0-4788-8983-49e5b60eb649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:12:20.222791 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2eac820f-2c47-4607-a9f2-4aa887c5d613 tempest-AttachVolumeShelveTestJSON-642976413 None] Created volume successfully.
Jan 25 13:12:35.940319 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:12:35.940870 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:12:35.941880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:12:36.003063 n-d-760454-3 sudo[113462]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:12:36.006699 n-d-760454-3 sudo[113462]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:12:36.501355 n-d-760454-3 sudo[113462]: pam_unix(sudo:session): session closed for user root
Jan 25 13:12:36.503621 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:12:36.505368 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:12:36.557531 n-d-760454-3 sudo[113473]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:12:36.561306 n-d-760454-3 sudo[113473]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:12:38.014050 n-d-760454-3 sudo[113473]: pam_unix(sudo:session): session closed for user root
Jan 25 13:12:38.016226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.511s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:12:38.017995 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:13:19.505396 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:13:19.510567 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:13:19.511118 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:13:19.557878 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (0fe6c349-0f05-40dc-8346-622759821ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:13:19.568173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f2d8f-42e4-4075-8481-bd1dbe6018ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:19.631408 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:13:19.698987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f2d8f-42e4-4075-8481-bd1dbe6018ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1805577374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=66508876-abfc-47aa-9ab0-07499e3f8e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a33ab25e364029b4c4ea0ed6ee67b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:13:19Z,user_id='4571425d34834e9d985bfeb7b23c178e',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:19.698987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0209b8-1bbc-4a88-9e40-3bc214a214c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:19.698987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0209b8-1bbc-4a88-9e40-3bc214a214c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:19.700819 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856aa661-cd1e-44da-9f2f-9e86823d9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:19.703486 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856aa661-cd1e-44da-9f2f-9e86823d9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66508876-abfc-47aa-9ab0-07499e3f8e94', 'volume_name': 'volume-66508876-abfc-47aa-9ab0-07499e3f8e94', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:19.714408 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e64d99-cfa1-43db-ad7d-bbe843cc4b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:19.723519 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e64d99-cfa1-43db-ad7d-bbe843cc4b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:19.734828 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47685f-e1c7-47c7-949c-7d8c02f0b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:19.736070 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Volume 66508876-abfc-47aa-9ab0-07499e3f8e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66508876-abfc-47aa-9ab0-07499e3f8e94', 'volume_size': 1}
Jan 25 13:13:19.737466 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-66508876-abfc-47aa-9ab0-07499e3f8e94 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:19.835802 n-d-760454-3 sudo[114140]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-66508876-abfc-47aa-9ab0-07499e3f8e94 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:13:19.849105 n-d-760454-3 sudo[114140]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:20.628392 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-558f76e5-40e0-4909-bf4e-261e013bf483 req-e76ee209-4a1c-48c1-bacb-345d5147bf65 tempest-AttachVolumeShelveTestJSON-642976413 None] No connector for attachment 3ce61d86-3cbd-4ff2-b449-a778f0223841; skipping storage backend terminate_connection call. {{(pid=89244) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4627}}
Jan 25 13:13:20.633911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-558f76e5-40e0-4909-bf4e-261e013bf483 req-e76ee209-4a1c-48c1-bacb-345d5147bf65 tempest-AttachVolumeShelveTestJSON-642976413 None] Deleting attachment 3ce61d86-3cbd-4ff2-b449-a778f0223841. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:13:20.839988 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-558f76e5-40e0-4909-bf4e-261e013bf483 req-e76ee209-4a1c-48c1-bacb-345d5147bf65 tempest-AttachVolumeShelveTestJSON-642976413 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:13:20.839988 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:13:20.839988 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:13:20.941169 n-d-760454-3 sudo[114140]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:20.943395 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-66508876-abfc-47aa-9ab0-07499e3f8e94 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.206s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:20.947880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47685f-e1c7-47c7-949c-7d8c02f0b689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66508876-abfc-47aa-9ab0-07499e3f8e94', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:20.950838 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1fea1c-3469-4710-8a36-3b7e3e7d72cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:21.034866 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Volume volume-66508876-abfc-47aa-9ab0-07499e3f8e94 (66508876-abfc-47aa-9ab0-07499e3f8e94): created successfully
Jan 25 13:13:21.036951 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1fea1c-3469-4710-8a36-3b7e3e7d72cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:21.041763 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (0fe6c349-0f05-40dc-8346-622759821ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:13:21.125823 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ae24a2fc-5358-4ab2-bf22-3b917cd1a030 tempest-AttachVolumeTestJSON-450288000 None] Created volume successfully.
Jan 25 13:13:23.661756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:23.684278 n-d-760454-3 sudo[114225]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:23.684936 n-d-760454-3 sudo[114225]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:24.289363 n-d-760454-3 sudo[114225]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:24.291867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94" returned: 0 in 0.630s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:24.426190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:24.453045 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.028s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:24.453624 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 18
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 19
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 20
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:24.455252 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:13:24.468893 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Creating iscsi_target for Volume ID: volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Created volume path /opt/stack/data/cinder/volumes/volume-66508876-abfc-47aa-9ab0-07499e3f8e94,
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94>
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:     incominguser yMXmCVzerpm4ZcwASQ5y xk7pAostNZh5NmYw
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:13:24.588888 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:13:24.592514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:25.420645 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94" returned: 0 in 0.828s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:25.422042 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:25.422763 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:13:25.423241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:13:25.424679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:25.441041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.016s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:25.441810 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 18
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 19
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 20
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:25.442857 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:13:25.458008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:25.549314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.092s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:25.549910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:25.553126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:25.672604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:25.673197 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:25.675647 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] Set provider_location to: 10.222.0.65:3260,5 iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:13:26.112742 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-bd6f3628-0d0d-4976-87e2-7d14d772e923 req-8208bc06-839b-4647-91e3-aa900b3b62b6 tempest-AttachVolumeTestJSON-450288000 None] attachment_update completed successfully.
Jan 25 13:13:35.124030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:13:35.128972 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:13:35.130027 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:13:35.153445 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (92a5b618-5228-4326-8bee-3ceca6bced7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:13:35.177107 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130c161a-7fe6-463b-8459-804caa694d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:35.217285 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:13:35.264245 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130c161a-7fe6-463b-8459-804caa694d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-837639000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b3e355ee-820f-4e80-aad2-268d141af8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a33ab25e364029b4c4ea0ed6ee67b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:13:35Z,user_id='4571425d34834e9d985bfeb7b23c178e',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:35.271029 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cdce3a-5165-459d-a12e-065465576b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:35.275398 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cdce3a-5165-459d-a12e-065465576b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:35.281138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eea008-65b9-444d-bab2-ec8efbd8a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:35.298148 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eea008-65b9-444d-bab2-ec8efbd8a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e355ee-820f-4e80-aad2-268d141af8dc', 'volume_name': 'volume-b3e355ee-820f-4e80-aad2-268d141af8dc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:35.304284 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72e290c-c93e-496f-815a-cbbbacdc7b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:35.316593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72e290c-c93e-496f-815a-cbbbacdc7b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:35.322921 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc10499-078b-407a-bc3b-716fa0484134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:35.329023 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Volume b3e355ee-820f-4e80-aad2-268d141af8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e355ee-820f-4e80-aad2-268d141af8dc', 'volume_size': 1}
Jan 25 13:13:35.329023 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b3e355ee-820f-4e80-aad2-268d141af8dc stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:35.372650 n-d-760454-3 sudo[114355]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b3e355ee-820f-4e80-aad2-268d141af8dc stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:13:35.374342 n-d-760454-3 sudo[114355]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:35.957847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:13:35.957847 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:13:35.957847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:36.015392 n-d-760454-3 sudo[114357]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:13:36.015926 n-d-760454-3 sudo[114357]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:36.694776 n-d-760454-3 sudo[114355]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:36.697881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b3e355ee-820f-4e80-aad2-268d141af8dc stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.371s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:36.701359 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc10499-078b-407a-bc3b-716fa0484134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e355ee-820f-4e80-aad2-268d141af8dc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:36.703962 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33997b3e-b7f2-4d36-a0fd-52e72606cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:13:36.790702 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Volume volume-b3e355ee-820f-4e80-aad2-268d141af8dc (b3e355ee-820f-4e80-aad2-268d141af8dc): created successfully
Jan 25 13:13:36.792968 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33997b3e-b7f2-4d36-a0fd-52e72606cc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:13:36.796342 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Flow 'volume_create_manager' (92a5b618-5228-4326-8bee-3ceca6bced7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:13:36.880642 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e1e5299c-089f-41ac-9152-f25aa32a32fc tempest-AttachVolumeTestJSON-450288000 None] Created volume successfully.
Jan 25 13:13:36.926228 n-d-760454-3 sudo[114357]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:36.928058 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.982s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:36.929355 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:36.983064 n-d-760454-3 sudo[114390]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:13:37.001138 n-d-760454-3 sudo[114390]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:38.037643 n-d-760454-3 sudo[114390]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:38.040517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.110s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:38.042152 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:13:41.658450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:41.745091 n-d-760454-3 sudo[114480]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:13:41.761670 n-d-760454-3 sudo[114480]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:13:42.601572 n-d-760454-3 sudo[114480]: pam_unix(sudo:session): session closed for user root
Jan 25 13:13:42.604833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc" returned: 0 in 0.946s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:42.674484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:42.699537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.026s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:42.700304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 21\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 18
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 19
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 20
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]: Target 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 21
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00050000
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf50
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00050001
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf51
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         yMXmCVzerpm4ZcwASQ5y
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:42.701640 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:13:42.730581 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Creating iscsi_target for Volume ID: volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Created volume path /opt/stack/data/cinder/volumes/volume-b3e355ee-820f-4e80-aad2-268d141af8dc,
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc>
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:     incominguser LsKdFRH8ayc8QZyMeK79 esXg3kSgAko9fEbU
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:13:42.843577 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:13:42.846776 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:43.561043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc" returned: 0 in 0.715s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:43.561275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:43.562166 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:13:43.562734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:13:43.566013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:43.582934 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.018s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:43.583515 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 21\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 18
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LC9eGp2bsRTmJUtzvHqt
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 19
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         8zNckbrCGhTWJsGMond2
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]: Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 20
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040000
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf40
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00040001
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf41
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         PC4aQRCMeCv6SKGVFHu4
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]: Target 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 21
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00050000
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf50
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00050001
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf51
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         yMXmCVzerpm4ZcwASQ5y
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:13:43.584417 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:13:43.606914 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:43.830792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.232s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:43.831745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 21\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:43.835026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:44.043664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.209s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:44.044442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 21\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:44.045987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] Set provider_location to: 10.222.0.65:3260,6 iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:13:44.591021 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ea4e428a-c7e6-4b5b-b1b9-7c435884ff5f req-fbfb7ad9-9ccd-4901-9df1-3c4d273ec77d tempest-AttachVolumeTestJSON-450288000 None] attachment_update completed successfully.
Jan 25 13:13:54.018831 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-1c337520-558b-4f5f-883b-9cbaaa1ab0ed req-f5fbf2c7-1620-408e-8e05-7e83b3d67e02 tempest-AttachVolumeTestJSON-450288000 None] Terminate volume connection completed successfully.
Jan 25 13:13:54.020353 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-1c337520-558b-4f5f-883b-9cbaaa1ab0ed req-f5fbf2c7-1620-408e-8e05-7e83b3d67e02 tempest-AttachVolumeTestJSON-450288000 None] Deleting attachment df7c2996-7166-463b-ac05-14c2e3e5b375. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:13:54.024825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:54.127455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.104s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:54.128110 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 5: iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00050000\n            SCSI SN: beaf50\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00050001\n            SCSI SN: beaf51\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94\n            Backing store flags: \n    Account information:\n        yMXmCVzerpm4ZcwASQ5y\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 22\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:54.129368 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-1c337520-558b-4f5f-883b-9cbaaa1ab0ed req-f5fbf2c7-1620-408e-8e05-7e83b3d67e02 tempest-AttachVolumeTestJSON-450288000 None] Removing iscsi_target for Volume ID: 66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:13:54.133252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:54.226778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-66508876-abfc-47aa-9ab0-07499e3f8e94 -f" returned: 0 in 0.093s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:54.228840 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:54.233490 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:54.386222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.154s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:54.386944 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 22\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:54.598563 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-1c337520-558b-4f5f-883b-9cbaaa1ab0ed req-f5fbf2c7-1620-408e-8e05-7e83b3d67e02 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:13:54.598563 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:13:54.598563 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:13:57.500231 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-7d0dd402-6835-418d-aa04-344928a1c17a req-c4fcb97a-363c-44ff-989a-089c52831210 tempest-AttachVolumeTestJSON-450288000 None] Terminate volume connection completed successfully.
Jan 25 13:13:57.500915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-7d0dd402-6835-418d-aa04-344928a1c17a req-c4fcb97a-363c-44ff-989a-089c52831210 tempest-AttachVolumeTestJSON-450288000 None] Deleting attachment 14b725e8-67fc-4e52-9915-c373a667772b. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:13:57.503451 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:57.758328 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.254s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:57.758650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\nTarget 6: iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00060000\n            SCSI SN: beaf60\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00060001\n            SCSI SN: beaf61\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc\n            Backing store flags: \n    Account information:\n        LsKdFRH8ayc8QZyMeK79\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:57.759308 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-7d0dd402-6835-418d-aa04-344928a1c17a req-c4fcb97a-363c-44ff-989a-089c52831210 tempest-AttachVolumeTestJSON-450288000 None] Removing iscsi_target for Volume ID: b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:13:57.762557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:58.026692 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-b3e355ee-820f-4e80-aad2-268d141af8dc -f" returned: 0 in 0.265s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:58.027265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:58.028980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:13:58.279187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.249s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:13:58.279765 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:13:58.456240 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-7d0dd402-6835-418d-aa04-344928a1c17a req-c4fcb97a-363c-44ff-989a-089c52831210 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:13:58.456240 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:13:58.456240 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:04.595428 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:14:04.603448 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:14:04.604209 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:14:04.664728 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Flow 'volume_create_manager' (a064a299-7455-492b-8f45-97e55dc71e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:04.705915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b756b779-856a-40b6-a54d-0ffb72229cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:04.755314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:14:04.806236 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b756b779-856a-40b6-a54d-0ffb72229cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-232653974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=0cd01bc6-31b3-4503-bd74-992c4c5eade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453d4ab8506d4f52baa6bae80bee3914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:14:04Z,user_id='ec968438c91948e8a1fa02661de0c1a2',volume_attachment=<?>,volume_type=VolumeType(646f73eb-1f52-4137-988b-f1e6d7d0493e),volume_type_id=646f73eb-1f52-4137-988b-f1e6d7d0493e)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:04.810941 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba83d69-a264-4088-8b09-84d0ab224ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:04.817691 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba83d69-a264-4088-8b09-84d0ab224ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:04.825720 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ca6e81-cf99-4f77-9b37-e869671c094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:04.828943 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ca6e81-cf99-4f77-9b37-e869671c094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd01bc6-31b3-4503-bd74-992c4c5eade5', 'volume_name': 'volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:04.843776 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d30a9f9-95bb-4948-9150-28603d16a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:04.846500 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d30a9f9-95bb-4948-9150-28603d16a188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:04.848984 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4a9916-b903-4bfd-9fa8-bb45ea3f53df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:04.850609 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Volume 0cd01bc6-31b3-4503-bd74-992c4c5eade5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5', 'volume_size': 1}
Jan 25 13:14:04.852459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:04.919734 n-d-760454-3 sudo[114761]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:14:04.921489 n-d-760454-3 sudo[114761]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:05.651110 n-d-760454-3 sudo[114761]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:05.653377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.801s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:05.657289 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4a9916-b903-4bfd-9fa8-bb45ea3f53df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:05.659949 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43fa812-6f74-41c5-b27f-3e6ef0873825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:05.707975 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Volume volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 (0cd01bc6-31b3-4503-bd74-992c4c5eade5): created successfully
Jan 25 13:14:05.710250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43fa812-6f74-41c5-b27f-3e6ef0873825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:05.714585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Flow 'volume_create_manager' (a064a299-7455-492b-8f45-97e55dc71e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:05.754677 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6d69e521-2160-49ac-8a4a-c03f31fc0dcb tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Created volume successfully.
Jan 25 13:14:08.037693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:08.041363 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:08.089510 n-d-760454-3 sudo[114842]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:08.090091 n-d-760454-3 sudo[114842]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:08.704749 n-d-760454-3 sudo[114842]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:08.707227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:08.708829 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:08.759427 n-d-760454-3 sudo[114864]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:08.760235 n-d-760454-3 sudo[114864]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:09.675729 n-d-760454-3 sudo[114864]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:09.678188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.969s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:09.680700 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:09.688051 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ec4cd7d5-951f-452e-a5bd-c3a6fc1bbf1f tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Retype volume completed successfully.
Jan 25 13:14:09.787744 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Lock "b'cinder-0cd01bc6-31b3-4503-bd74-992c4c5eade5-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:09.991884 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Skipping remove_export. No iscsi_target is presently exported for volume: 0cd01bc6-31b3-4503-bd74-992c4c5eade5
Jan 25 13:14:09.992960 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:10.032186 n-d-760454-3 sudo[114884]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5
Jan 25 13:14:10.033585 n-d-760454-3 sudo[114884]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:10.677001 n-d-760454-3 sudo[114884]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:10.680118 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5" returned: 0 in 0.686s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:10.683413 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:10.703142 n-d-760454-3 sudo[114891]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5
Jan 25 13:14:10.703658 n-d-760454-3 sudo[114891]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:11.143243 n-d-760454-3 sudo[114891]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:11.145362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5" returned: 0 in 0.462s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:11.147506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:11.170723 n-d-760454-3 sudo[114904]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5
Jan 25 13:14:11.174681 n-d-760454-3 sudo[114904]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:11.779632 n-d-760454-3 sudo[114904]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:11.782250 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0cd01bc6-31b3-4503-bd74-992c4c5eade5" returned: 0 in 0.634s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:11.783516 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Successfully deleted volume: 0cd01bc6-31b3-4503-bd74-992c4c5eade5
Jan 25 13:14:11.817515 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:14:11.818436 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:14:11.884447 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Created reservations ['6a0915c3-eec3-4e87-926a-8cd56a19ad4f', '0d77ed10-262c-4693-bf16-e6a715285a58', 'b753be82-72e3-4cff-8eb4-00580678fe6a', '0ef7f4ac-aa94-4824-9fdd-e21075cb201f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:11.887263 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:11.887263 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:11.887263 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:12.012484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:12.013635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:12.036205 n-d-760454-3 sudo[114915]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:12.036826 n-d-760454-3 sudo[114915]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:12.431044 n-d-760454-3 sudo[114915]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:12.434221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:12.436643 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:12.456074 n-d-760454-3 sudo[114919]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:12.457397 n-d-760454-3 sudo[114919]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:13.205044 n-d-760454-3 sudo[114919]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:13.210059 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.773s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:13.216806 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:13.234262 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Deleted volume successfully.
Jan 25 13:14:13.307837 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8052b680-ba5d-4473-bd9e-aa931850a151 tempest-VolumeRetypeWithoutMigrationTest-564007757 None] Lock "b'cinder-0cd01bc6-31b3-4503-bd74-992c4c5eade5-delete_volume'" released by "delete_volume" :: held 3.520s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:21.356034 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-b3e355ee-820f-4e80-aad2-268d141af8dc-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:21.509101 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:21.621849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.114s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:21.622669 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:14:21.623904 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Skipping remove_export. No iscsi_target is presently exported for volume: b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:14:21.624981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:21.645009 n-d-760454-3 sudo[115048]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:14:21.646608 n-d-760454-3 sudo[115048]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:22.569269 n-d-760454-3 sudo[115048]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:22.571632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc" returned: 0 in 0.946s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:22.577266 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:22.628108 n-d-760454-3 sudo[115055]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:14:22.628731 n-d-760454-3 sudo[115055]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:23.148983 n-d-760454-3 sudo[115055]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:23.151427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc" returned: 0 in 0.575s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:23.153630 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:23.174155 n-d-760454-3 sudo[115059]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:14:23.175260 n-d-760454-3 sudo[115059]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:23.821051 n-d-760454-3 sudo[115059]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:23.828365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b3e355ee-820f-4e80-aad2-268d141af8dc" returned: 0 in 0.669s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:23.829724 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Successfully deleted volume: b3e355ee-820f-4e80-aad2-268d141af8dc
Jan 25 13:14:23.942121 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Created reservations ['592b8a26-47e6-4bbf-b0bf-655cf72a0a66', 'aa665399-6c46-474d-bcc3-842fdf0ed35e', '892e8870-e15e-4d04-ad4b-30c2c2f1a65e', '06d6b4d9-74e5-43ad-a10c-8ea2cbffa382'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:23.945261 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:23.945261 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:23.945261 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:24.084403 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:24.085619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:24.109643 n-d-760454-3 sudo[115089]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:24.111288 n-d-760454-3 sudo[115089]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:24.519119 n-d-760454-3 sudo[115089]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:24.521906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:24.525571 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:24.544983 n-d-760454-3 sudo[115106]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:24.545947 n-d-760454-3 sudo[115106]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:25.416080 n-d-760454-3 sudo[115106]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:25.428080 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.901s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:25.430569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:25.454131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-66508876-abfc-47aa-9ab0-07499e3f8e94-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:25.465576 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Deleted volume successfully.
Jan 25 13:14:25.620782 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7e0a0a26-3d85-4cbc-9ae2-3586d0d0b7f3 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-b3e355ee-820f-4e80-aad2-268d141af8dc-delete_volume'" released by "delete_volume" :: held 4.264s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:25.652721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:25.810696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.157s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:25.811048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:14:25.812108 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Skipping remove_export. No iscsi_target is presently exported for volume: 66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:14:25.813442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:25.839311 n-d-760454-3 sudo[115142]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:14:25.840513 n-d-760454-3 sudo[115142]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:26.377954 n-d-760454-3 sudo[115142]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:26.383089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94" returned: 0 in 0.566s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:26.383089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:26.413776 n-d-760454-3 sudo[115156]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:14:26.414563 n-d-760454-3 sudo[115156]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:26.937984 n-d-760454-3 sudo[115156]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:26.940119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94" returned: 0 in 0.558s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:26.942784 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:26.979750 n-d-760454-3 sudo[115162]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:14:26.980964 n-d-760454-3 sudo[115162]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:27.522543 n-d-760454-3 sudo[115162]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:27.525396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-66508876-abfc-47aa-9ab0-07499e3f8e94" returned: 0 in 0.582s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:27.526812 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Successfully deleted volume: 66508876-abfc-47aa-9ab0-07499e3f8e94
Jan 25 13:14:27.633589 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Created reservations ['a3e1e299-c60c-4245-ab04-b0c8b4874c7f', 'cfa9f5cb-efe8-43b7-8875-d735b3b1eb09', '357d4f0d-864b-49a1-9c9f-e642a25f83e7', '0c202dbb-9265-4bce-a850-096f756cca37'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:27.636212 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:27.636212 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:27.636212 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:27.781790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:27.782990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:27.802482 n-d-760454-3 sudo[115171]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:27.805174 n-d-760454-3 sudo[115171]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:28.298985 n-d-760454-3 sudo[115171]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:28.302538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:28.305034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:28.326503 n-d-760454-3 sudo[115177]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:28.327592 n-d-760454-3 sudo[115177]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:28.625879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-fa90bb0b-3610-41d3-9d45-e2579eb19bba-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:28.797033 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:28.983527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.186s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:28.983974 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:14:28.984950 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Skipping remove_export. No iscsi_target is presently exported for volume: fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:14:28.986188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:29.004189 n-d-760454-3 sudo[115183]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:14:29.004780 n-d-760454-3 sudo[115183]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:29.122073 n-d-760454-3 sudo[115177]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:29.125345 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.820s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:29.127841 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:29.135575 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Deleted volume successfully.
Jan 25 13:14:29.183296 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c38515f0-0b46-4af0-a06c-aa35d5f89807 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-66508876-abfc-47aa-9ab0-07499e3f8e94-delete_volume'" released by "delete_volume" :: held 3.729s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:29.602245 n-d-760454-3 sudo[115183]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:29.604410 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba" returned: 0 in 0.618s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:29.606370 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:29.628846 n-d-760454-3 sudo[115194]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:14:29.630222 n-d-760454-3 sudo[115194]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:30.090485 n-d-760454-3 sudo[115194]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:30.092813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba" returned: 0 in 0.486s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:30.095033 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:30.112915 n-d-760454-3 sudo[115201]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:14:30.114186 n-d-760454-3 sudo[115201]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:30.746030 n-d-760454-3 sudo[115201]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:30.748619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-fa90bb0b-3610-41d3-9d45-e2579eb19bba" returned: 0 in 0.653s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:30.749893 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Successfully deleted volume: fa90bb0b-3610-41d3-9d45-e2579eb19bba
Jan 25 13:14:30.856476 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Created reservations ['32b3e4ae-0868-4ead-955f-c98cf2e04842', 'dfb11369-2c9b-4395-9300-bd8f6111b26a', 'acade525-e678-4564-890f-064a704626fb', 'c97bdc9f-b804-455a-a523-411f82df268d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:30.860799 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:30.860799 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:30.860799 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:31.015799 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:31.017451 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:31.073827 n-d-760454-3 sudo[115210]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:31.074365 n-d-760454-3 sudo[115210]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:31.475947 n-d-760454-3 sudo[115210]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:31.478041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:31.479839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:31.497810 n-d-760454-3 sudo[115214]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:31.499050 n-d-760454-3 sudo[115214]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:32.104650 n-d-760454-3 sudo[115214]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:32.106879 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:32.108779 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:32.114566 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Deleted volume successfully.
Jan 25 13:14:32.172919 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-423f6b56-8c8c-431f-8c3c-52726639cec4 tempest-AttachVolumeTestJSON-450288000 None] Lock "b'cinder-fa90bb0b-3610-41d3-9d45-e2579eb19bba-delete_volume'" released by "delete_volume" :: held 3.547s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:32.624103 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:14:32.628881 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:14:32.629437 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:14:32.644773 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Flow 'volume_create_manager' (67ced2f9-42f9-4381-a751-dce5e5023a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:32.648267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff1f32d-a9b1-4c79-9617-246dc07445c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:32.673175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:14:32.702496 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff1f32d-a9b1-4c79-9617-246dc07445c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1828380851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=96cc58ef-d535-4e41-840f-250d195c261b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473ec7c8d22047a880f85dbb0d64e274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:14:33Z,user_id='73394006f245427c97447a48f1d255d0',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:32.705414 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a159d-719c-4837-8a7f-71a516446958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:32.707816 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206a159d-719c-4837-8a7f-71a516446958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:32.711153 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc742a3-b527-4cbc-af97-d5e677851b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:32.713748 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc742a3-b527-4cbc-af97-d5e677851b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cc58ef-d535-4e41-840f-250d195c261b', 'volume_name': 'volume-96cc58ef-d535-4e41-840f-250d195c261b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:32.716250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4987ed75-7018-417e-b3be-7769b348f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:32.719318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4987ed75-7018-417e-b3be-7769b348f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:32.722400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755b20a-edf7-494b-b611-5185a686ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:32.723304 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Volume 96cc58ef-d535-4e41-840f-250d195c261b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cc58ef-d535-4e41-840f-250d195c261b', 'volume_size': 1}
Jan 25 13:14:32.724464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-96cc58ef-d535-4e41-840f-250d195c261b stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:32.748964 n-d-760454-3 sudo[115231]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-96cc58ef-d535-4e41-840f-250d195c261b stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:14:32.749929 n-d-760454-3 sudo[115231]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:33.413423 n-d-760454-3 sudo[115231]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:33.415963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-96cc58ef-d535-4e41-840f-250d195c261b stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.691s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:33.419951 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755b20a-edf7-494b-b611-5185a686ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cc58ef-d535-4e41-840f-250d195c261b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:33.422625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaa316e-2715-4159-b8b3-4c4fa9403991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:33.466367 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Volume volume-96cc58ef-d535-4e41-840f-250d195c261b (96cc58ef-d535-4e41-840f-250d195c261b): created successfully
Jan 25 13:14:33.469119 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaa316e-2715-4159-b8b3-4c4fa9403991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:33.481121 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Flow 'volume_create_manager' (67ced2f9-42f9-4381-a751-dce5e5023a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:33.519036 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b508712f-1469-4f5c-8735-8b0cd9af837e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Created volume successfully.
Jan 25 13:14:34.515994 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5756e02b-6d0d-4ede-bcbf-2b43754c3c88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:34.552489 n-d-760454-3 sudo[115274]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:34.554335 n-d-760454-3 sudo[115274]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:35.203788 n-d-760454-3 sudo[115274]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:35.206326 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5756e02b-6d0d-4ede-bcbf-2b43754c3c88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b" returned: 0 in 0.690s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:35.207449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5756e02b-6d0d-4ede-bcbf-2b43754c3c88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d --snapshot stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:35.233648 n-d-760454-3 sudo[115297]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d --snapshot stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b -L 1.00g
Jan 25 13:14:35.234196 n-d-760454-3 sudo[115297]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:35.947638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:14:35.948140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:35.949555 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:36.072892 n-d-760454-3 sudo[115329]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:36.073466 n-d-760454-3 sudo[115329]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:36.401547 n-d-760454-3 sudo[115297]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:36.404387 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5756e02b-6d0d-4ede-bcbf-2b43754c3c88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d --snapshot stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b -L 1.00g" returned: 0 in 1.196s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:36.535014 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5756e02b-6d0d-4ede-bcbf-2b43754c3c88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Create snapshot completed successfully
Jan 25 13:14:36.819362 n-d-760454-3 sudo[115329]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:36.821016 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.872s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:36.822529 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:36.882748 n-d-760454-3 sudo[115419]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:36.884214 n-d-760454-3 sudo[115419]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:37.713738 n-d-760454-3 sudo[115419]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:37.715771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:37.717701 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:38.060522 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Lock "b'cinder-722d9dc2-63bf-4fb3-84be-8e109def540d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:38.063580 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:38.101688 n-d-760454-3 sudo[115434]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d
Jan 25 13:14:38.102790 n-d-760454-3 sudo[115434]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:38.910637 n-d-760454-3 sudo[115434]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:38.913554 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d" returned: 0 in 0.850s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:38.915721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:38.938378 n-d-760454-3 sudo[115443]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d
Jan 25 13:14:38.939128 n-d-760454-3 sudo[115443]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:40.102141 n-d-760454-3 sudo[115443]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:40.104975 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-722d9dc2-63bf-4fb3-84be-8e109def540d" returned: 0 in 1.189s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:40.206035 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Deprecated: Default quota for resource: snapshots_lvmdriver-1 is set by the default quota flag: quota_snapshots_lvmdriver-1, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:14:40.287369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Created reservations ['d8db489f-ced8-487d-a1de-4ab2489f3972', '08cd28b7-9127-4fa7-87e4-fc2917f00b22', 'f1af6ab5-c955-476e-b821-599f4ecccb78', 'f584027a-c136-4ec3-b0cc-51b8a2c40a7a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:40.287369 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:40.287369 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:40.287369 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:40.484424 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Delete snapshot completed successfully.
Jan 25 13:14:40.490975 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33514573-9a60-4835-8677-78fada09b87e tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Lock "b'cinder-722d9dc2-63bf-4fb3-84be-8e109def540d-delete_snapshot'" released by "delete_snapshot" :: held 2.431s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:41.485454 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Lock "b'cinder-96cc58ef-d535-4e41-840f-250d195c261b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:14:41.576022 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Skipping remove_export. No iscsi_target is presently exported for volume: 96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:41.576954 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:41.593231 n-d-760454-3 sudo[115515]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:41.593839 n-d-760454-3 sudo[115515]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:42.180420 n-d-760454-3 sudo[115515]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:42.183017 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b" returned: 0 in 0.605s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:42.184432 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:42.203337 n-d-760454-3 sudo[115521]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:42.203974 n-d-760454-3 sudo[115521]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:42.606192 n-d-760454-3 sudo[115521]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:42.611629 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b" returned: 0 in 0.424s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:42.615516 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:42.640407 n-d-760454-3 sudo[115525]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:42.641201 n-d-760454-3 sudo[115525]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:43.297372 n-d-760454-3 sudo[115525]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:43.299905 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-96cc58ef-d535-4e41-840f-250d195c261b" returned: 0 in 0.688s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:43.301378 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Successfully deleted volume: 96cc58ef-d535-4e41-840f-250d195c261b
Jan 25 13:14:43.386390 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Created reservations ['cd54d90b-f6c8-4f38-96ef-51631e310653', 'cec14d6e-dd23-4916-98aa-c3acfb41bb95', '7ab33c5d-936c-43d8-a69e-64fa57c57b23', '5f9d59d2-969c-4f45-9566-4d17e04d7b3a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:14:43.388771 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:14:43.388771 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:14:43.388771 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:14:43.483030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:14:43.483814 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:43.500140 n-d-760454-3 sudo[115534]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:14:43.500729 n-d-760454-3 sudo[115534]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:43.861664 n-d-760454-3 sudo[115534]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:43.864208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.380s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:43.867252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:43.925051 n-d-760454-3 sudo[115538]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:14:43.925994 n-d-760454-3 sudo[115538]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:44.685405 n-d-760454-3 sudo[115538]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:44.687618 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.820s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:44.689394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:14:44.700087 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Deleted volume successfully.
Jan 25 13:14:44.769933 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-185a35ae-792c-4442-8507-00515c9cdd3d tempest-VolumeSnapshotQuotasNegativeTestJSON-1788028625 None] Lock "b'cinder-96cc58ef-d535-4e41-840f-250d195c261b-delete_volume'" released by "delete_volume" :: held 3.285s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:14:55.622965 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:14:55.628605 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:14:55.629357 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:14:55.664593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Flow 'volume_create_manager' (3a2594b3-47e3-44d0-8341-34697840dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:55.668946 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb63c6-a9f7-426d-920a-5a82100a580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:55.721824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:14:55.753203 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb63c6-a9f7-426d-920a-5a82100a580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-813073996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=8d099c9c-6aef-468d-ae15-f076157ec114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07809214ec634b7aa6f219aaad1ebf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:14:56Z,user_id='c51649d330b54c4a9966f133d9f91fd0',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:55.756397 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93357044-5f1e-44bf-adc5-8c653f1b386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:55.758890 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93357044-5f1e-44bf-adc5-8c653f1b386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:55.761603 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0b9c7-74a3-4b7e-99c5-b05f6fac9653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:55.764408 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0b9c7-74a3-4b7e-99c5-b05f6fac9653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d099c9c-6aef-468d-ae15-f076157ec114', 'volume_name': 'volume-8d099c9c-6aef-468d-ae15-f076157ec114', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:55.766997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e3ec16-9f9b-4855-8f1c-d1e70918853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:55.771642 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e3ec16-9f9b-4855-8f1c-d1e70918853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:55.774984 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11448efc-9c62-44a1-a585-047ab4c87363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:55.776032 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Volume 8d099c9c-6aef-468d-ae15-f076157ec114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d099c9c-6aef-468d-ae15-f076157ec114', 'volume_size': 1}
Jan 25 13:14:55.777202 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8d099c9c-6aef-468d-ae15-f076157ec114 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:14:55.794785 n-d-760454-3 sudo[115624]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8d099c9c-6aef-468d-ae15-f076157ec114 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:14:55.795322 n-d-760454-3 sudo[115624]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:14:56.541747 n-d-760454-3 sudo[115624]: pam_unix(sudo:session): session closed for user root
Jan 25 13:14:56.544957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8d099c9c-6aef-468d-ae15-f076157ec114 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.767s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:14:56.551502 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11448efc-9c62-44a1-a585-047ab4c87363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d099c9c-6aef-468d-ae15-f076157ec114', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:56.555367 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ffeb78-4a00-49b2-8dc3-0ecf9e593dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:14:56.603868 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Volume volume-8d099c9c-6aef-468d-ae15-f076157ec114 (8d099c9c-6aef-468d-ae15-f076157ec114): created successfully
Jan 25 13:14:56.606146 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ffeb78-4a00-49b2-8dc3-0ecf9e593dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:14:56.609481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Flow 'volume_create_manager' (3a2594b3-47e3-44d0-8341-34697840dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:14:56.642771 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2a75c474-5dcc-444a-86ba-159355d0ae82 tempest-ServersNegativeTestJSON-380865974 None] Created volume successfully.
Jan 25 13:15:00.183345 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:00.188968 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:00.189614 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:00.208790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Flow 'volume_create_manager' (fbf7af4f-9c28-4876-8af4-95566be1d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:00.213735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1d4722-9577-4b4b-a443-5d7dc2dbb574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:00.254678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:00.327209 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1d4722-9577-4b4b-a443-5d7dc2dbb574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1997420454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=a0e4d92f-b693-4a09-abae-c6fbbc2c9b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07809214ec634b7aa6f219aaad1ebf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:00Z,user_id='c51649d330b54c4a9966f133d9f91fd0',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:00.336974 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3630af-9037-4d6a-8e91-9184a979455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:00.339600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3630af-9037-4d6a-8e91-9184a979455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:00.342293 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7270028c-0dbd-4045-87ef-f2b57a2f33a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:00.344777 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7270028c-0dbd-4045-87ef-f2b57a2f33a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e4d92f-b693-4a09-abae-c6fbbc2c9b82', 'volume_name': 'volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:00.358642 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c06c639-7c18-4649-bbfe-4d18d146a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:00.366860 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c06c639-7c18-4649-bbfe-4d18d146a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:00.369569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8601ebae-898c-4352-8110-85008911ce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:00.370443 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Volume a0e4d92f-b693-4a09-abae-c6fbbc2c9b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82', 'volume_size': 1}
Jan 25 13:15:00.375259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:00.414600 n-d-760454-3 sudo[115675]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:00.429452 n-d-760454-3 sudo[115675]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:01.523422 n-d-760454-3 sudo[115675]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:01.525677 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.154s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:01.529856 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8601ebae-898c-4352-8110-85008911ce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:01.532405 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd5458e-b7ed-47cc-96df-067777a3cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:01.613028 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Volume volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 (a0e4d92f-b693-4a09-abae-c6fbbc2c9b82): created successfully
Jan 25 13:15:01.613028 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd5458e-b7ed-47cc-96df-067777a3cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:01.616282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Flow 'volume_create_manager' (fbf7af4f-9c28-4876-8af4-95566be1d25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:01.659925 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cf9b5f74-74fc-47eb-b8f4-a30ae619344e tempest-ServersNegativeTestJSON-380865974 None] Created volume successfully.
Jan 25 13:15:10.874860 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:10.880892 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:10.885973 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:10.911742 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Flow 'volume_create_manager' (66cfb6c4-8ba8-4e28-a9f5-814a3060db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:10.929543 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9764e931-e4e4-4a75-b48b-33eb55173b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:10.984593 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:11.056790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9764e931-e4e4-4a75-b48b-33eb55173b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotManageAdminTest-Volume-635039275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=60657fde-7665-44d6-85aa-5a389f44e5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8755105cd3b847c88a645590549ca57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:11Z,user_id='c625660fad5147b3addbf052d4179aec',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:11.060002 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5532e-7916-4702-acd9-c5b3241687ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:11.062489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5532e-7916-4702-acd9-c5b3241687ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:11.068431 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e698fdca-bfed-4c06-8e53-55402a09b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:11.071223 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e698fdca-bfed-4c06-8e53-55402a09b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60657fde-7665-44d6-85aa-5a389f44e5aa', 'volume_name': 'volume-60657fde-7665-44d6-85aa-5a389f44e5aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:11.073846 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e714b71b-27ab-4f25-91e4-a83a366e5c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:11.076433 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e714b71b-27ab-4f25-91e4-a83a366e5c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:11.078905 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9c2183-1c70-45fd-b421-42f300e67eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:11.080113 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Volume 60657fde-7665-44d6-85aa-5a389f44e5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60657fde-7665-44d6-85aa-5a389f44e5aa', 'volume_size': 1}
Jan 25 13:15:11.081605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-60657fde-7665-44d6-85aa-5a389f44e5aa stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:11.112792 n-d-760454-3 sudo[115715]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-60657fde-7665-44d6-85aa-5a389f44e5aa stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:11.116138 n-d-760454-3 sudo[115715]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:11.998220 n-d-760454-3 sudo[115715]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:12.001862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-60657fde-7665-44d6-85aa-5a389f44e5aa stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.919s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:12.007369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9c2183-1c70-45fd-b421-42f300e67eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60657fde-7665-44d6-85aa-5a389f44e5aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:12.012736 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5c8aa-33a2-4e7f-b0b5-892e624147a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:12.056086 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Volume volume-60657fde-7665-44d6-85aa-5a389f44e5aa (60657fde-7665-44d6-85aa-5a389f44e5aa): created successfully
Jan 25 13:15:12.059587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5c8aa-33a2-4e7f-b0b5-892e624147a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:12.064779 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Flow 'volume_create_manager' (66cfb6c4-8ba8-4e28-a9f5-814a3060db6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:12.101116 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-76b0167a-2a8e-40d2-a05b-7aad2113f611 tempest-SnapshotManageAdminTest-134829707 None] Created volume successfully.
Jan 25 13:15:13.392779 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-63589950-69bf-441e-a368-ea33cad577ad tempest-GroupsV320Test-2105882795 None] Group tempest-GroupsV320Test-Group-1400284567: creating
Jan 25 13:15:13.511832 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-63589950-69bf-441e-a368-ea33cad577ad tempest-GroupsV320Test-2105882795 None] Group tempest-GroupsV320Test-Group-1400284567: created successfully
Jan 25 13:15:13.555911 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-63589950-69bf-441e-a368-ea33cad577ad tempest-GroupsV320Test-2105882795 None] Create group completed successfully.
Jan 25 13:15:13.991828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67f1af0d-8c3a-4c93-9cca-b8f082deb137 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:14.050147 n-d-760454-3 sudo[115748]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:14.050688 n-d-760454-3 sudo[115748]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:14.696101 n-d-760454-3 sudo[115748]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:14.700792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67f1af0d-8c3a-4c93-9cca-b8f082deb137 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa" returned: 0 in 0.708s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:14.708426 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67f1af0d-8c3a-4c93-9cca-b8f082deb137 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa --snapshot stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:14.749016 n-d-760454-3 sudo[115752]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa --snapshot stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa -L 1.00g
Jan 25 13:15:14.750967 n-d-760454-3 sudo[115752]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:15.872127 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Created reservations ['04f2f7b4-985f-4080-a7a1-468ddef02c1f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:16.005042 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:16.005042 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:16.005042 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:16.085399 n-d-760454-3 sudo[115752]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:16.120201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67f1af0d-8c3a-4c93-9cca-b8f082deb137 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa --snapshot stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa -L 1.00g" returned: 0 in 1.412s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:16.201480 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:16.202509 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:16.243117 n-d-760454-3 sudo[115862]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:16.245800 n-d-760454-3 sudo[115862]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:16.324348 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-67f1af0d-8c3a-4c93-9cca-b8f082deb137 tempest-SnapshotManageAdminTest-134829707 None] Create snapshot completed successfully
Jan 25 13:15:16.698427 n-d-760454-3 sudo[115862]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:16.700442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:16.707864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:16.775484 n-d-760454-3 sudo[115866]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:16.778284 n-d-760454-3 sudo[115866]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:17.737783 n-d-760454-3 sudo[115866]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:17.741912 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.033s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:17.752103 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:17.768309 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d717693d-fecc-4a1d-90ef-bd0b0378a1c3 tempest-GroupsV320Test-2105882795 None] Delete group completed successfully.
Jan 25 13:15:18.143723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1c7babb9-38a8-4567-b86d-88c58f97a0bc tempest-SnapshotManageAdminTest-1631610768 None] Lock "b'cinder-b9be2284-5d14-44d2-95a2-50b2b382b9aa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:18.339605 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-1c7babb9-38a8-4567-b86d-88c58f97a0bc tempest-SnapshotManageAdminTest-1631610768 None] Created reservations ['1fbeed78-396a-4ec1-aa42-a9c6f585e6d6', '26fdcc72-095f-4217-9e7f-24a7c1954926', '7c13a47c-1a99-4f51-b636-204853f7ec1b', '6778f056-eba2-4e1d-a9d9-2d6db56a3e31'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:18.342478 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-1c7babb9-38a8-4567-b86d-88c58f97a0bc tempest-SnapshotManageAdminTest-1631610768 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:18.342478 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:18.342478 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:18.507656 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1c7babb9-38a8-4567-b86d-88c58f97a0bc tempest-SnapshotManageAdminTest-1631610768 None] Unmanage snapshot completed successfully.
Jan 25 13:15:18.524991 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1c7babb9-38a8-4567-b86d-88c58f97a0bc tempest-SnapshotManageAdminTest-1631610768 None] Lock "b'cinder-b9be2284-5d14-44d2-95a2-50b2b382b9aa-delete_snapshot'" released by "delete_snapshot" :: held 0.381s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:20.227956 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] manage_existing_snapshot: managing {'source-name': '_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa'}. {{(pid=89244) manage_existing_snapshot /opt/stack/cinder/cinder/volume/manager.py:4421}}
Jan 25 13:15:20.228645 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Input parameters: context=<cinder.context.RequestContext object at 0x7f0e8fa8de80>, db=<module 'cinder.db' from '/opt/stack/cinder/cinder/db/__init__.py'>,driver=<cinder.volume.drivers.lvm.LVMVolumeDriver object at 0x7f0e8fa8ddd8>, host=n-d-760454-3@lvmdriver-1, snapshot_id=(snapshot_id)s, ref={'source-name': '_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa'}. {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py:321}}
Jan 25 13:15:20.234737 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Begin to return taskflow.engines.load(snapshot_flow,store=create_what). {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py:347}}
Jan 25 13:15:20.286248 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Flow 'snapshot_manage_existing_manager' (a89a131e-5dd0-480e-b4f4-8d654f426c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:20.297301 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.ExtractSnapshotRefTask;snapshot:manage_existing' (f2fa5ea3-8e8f-4fea-9fbc-0e663c62afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:20.430484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] ExtractSnapshotRefTask return snapshot_ref: Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2021-01-25T13:15:20Z,deleted=False,deleted_at=None,display_description='tempest-SnapshotManageAdminTest-Managed-Snapshot-Description-1634961982',display_name='tempest-SnapshotManageAdminTest-Managed-Snapshot-185241695',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=dbdbad5c-e25d-446a-a732-4ca9fb26ab61,metadata={manage-snap-meta1='value1',manage-snap-meta2='value2',manage-snap-meta3='value3'},progress='0%',project_id='2e1a470a90914c5184094103834f4da5',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,user_id='52194c15c2f14f86b77cf2d53dd38da0',volume=<?>,volume_id=60657fde-7665-44d6-85aa-5a389f44e5aa,volume_size=1,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6) {{(pid=89244) execute /opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py:57}}
Jan 25 13:15:20.434360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.ExtractSnapshotRefTask;snapshot:manage_existing' (f2fa5ea3-8e8f-4fea-9fbc-0e663c62afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2021-01-25T13:15:20Z,deleted=False,deleted_at=None,display_description='tempest-SnapshotManageAdminTest-Managed-Snapshot-Description-1634961982',display_name='tempest-SnapshotManageAdminTest-Managed-Snapshot-185241695',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=dbdbad5c-e25d-446a-a732-4ca9fb26ab61,metadata={manage-snap-meta1='value1',manage-snap-meta2='value2',manage-snap-meta3='value3'},progress='0%',project_id='2e1a470a90914c5184094103834f4da5',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,user_id='52194c15c2f14f86b77cf2d53dd38da0',volume=<?>,volume_id=60657fde-7665-44d6-85aa-5a389f44e5aa,volume_size=1,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:20.451712 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.NotifySnapshotActionTask;snapshot:manage_existing, manage_existing_snapshot.start' (49d38d12-4d87-4ef7-85bb-b6f03278ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:20.458668 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.NotifySnapshotActionTask;snapshot:manage_existing, manage_existing_snapshot.start' (49d38d12-4d87-4ef7-85bb-b6f03278ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:20.468069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.PrepareForQuotaReservationTask;snapshot:manage_existing' (66447672-eb36-4fbf-af00-a25a06771a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:20.469651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:20.533532 n-d-760454-3 sudo[115873]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa
Jan 25 13:15:20.534809 n-d-760454-3 sudo[115873]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:21.484333 n-d-760454-3 sudo[115873]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:21.487726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa" returned: 0 in 1.018s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:21.492301 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.PrepareForQuotaReservationTask;snapshot:manage_existing' (66447672-eb36-4fbf-af00-a25a06771a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'size': 1, 'snapshot_properties': Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2021-01-25T13:15:20Z,deleted=False,deleted_at=None,display_description='tempest-SnapshotManageAdminTest-Managed-Snapshot-Description-1634961982',display_name='tempest-SnapshotManageAdminTest-Managed-Snapshot-185241695',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=dbdbad5c-e25d-446a-a732-4ca9fb26ab61,metadata={manage-snap-meta1='value1',manage-snap-meta2='value2',manage-snap-meta3='value3'},progress='0%',project_id='2e1a470a90914c5184094103834f4da5',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,user_id='52194c15c2f14f86b77cf2d53dd38da0',volume=<?>,volume_id=60657fde-7665-44d6-85aa-5a389f44e5aa,volume_size=1,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:21.499426 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.QuotaReserveTask;snapshot:manage_existing' (a648c88b-af1f-434c-b270-81f0f9db08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:21.666724 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Created reservations ['5c99dd33-1e6f-4654-8dea-2934871b02b8', '5d08e7f1-2e39-4312-80bd-b5f5c828cbcb'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:21.669109 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.QuotaReserveTask;snapshot:manage_existing' (a648c88b-af1f-434c-b270-81f0f9db08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'reservations': ['5c99dd33-1e6f-4654-8dea-2934871b02b8', '5d08e7f1-2e39-4312-80bd-b5f5c828cbcb']}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:21.671786 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.ManageExistingTask;snapshot:manage_existing' (aaf72dfa-d39c-4c38-bd0c-3ef7dad71395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:21.677123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:21.696308 n-d-760454-3 sudo[115916]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa
Jan 25 13:15:21.697433 n-d-760454-3 sudo[115916]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:22.540094 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Lock "b'cinder-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:22.739979 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Skipping remove_export. No iscsi_target is presently exported for volume: ef40a4ec-ccd4-4f03-bb76-15756ce23cf7
Jan 25 13:15:22.741946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:22.761412 n-d-760454-3 sudo[115941]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7
Jan 25 13:15:22.762586 n-d-760454-3 sudo[115941]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:22.931767 n-d-760454-3 sudo[115916]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:22.934098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa" returned: 0 in 1.256s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:22.937320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): lvrename stack-volumes-lvmdriver-1 _snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa _snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:23.235483 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "lvrename stack-volumes-lvmdriver-1 _snapshot-b9be2284-5d14-44d2-95a2-50b2b382b9aa _snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61" returned: 0 in 0.297s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:23.236742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:15:23.390679 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.ManageExistingTask;snapshot:manage_existing' (aaf72dfa-d39c-4c38-bd0c-3ef7dad71395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'snapshot': Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2021-01-25T13:15:20Z,deleted=False,deleted_at=None,display_description='tempest-SnapshotManageAdminTest-Managed-Snapshot-Description-1634961982',display_name='tempest-SnapshotManageAdminTest-Managed-Snapshot-185241695',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=dbdbad5c-e25d-446a-a732-4ca9fb26ab61,metadata={manage-snap-meta1='value1',manage-snap-meta2='value2',manage-snap-meta3='value3'},progress='0%',project_id='2e1a470a90914c5184094103834f4da5',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,user_id='52194c15c2f14f86b77cf2d53dd38da0',volume=<?>,volume_id=60657fde-7665-44d6-85aa-5a389f44e5aa,volume_size=1,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6), 'new_status': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:23.393571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.QuotaCommitTask;snapshot:manage_existing' (c0377d2f-d5a2-462c-aacf-d51c7057528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:23.474407 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.QuotaCommitTask;snapshot:manage_existing' (c0377d2f-d5a2-462c-aacf-d51c7057528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'snapshot_properties': Snapshot(cgsnapshot=<?>,cgsnapshot_id=None,created_at=2021-01-25T13:15:20Z,deleted=False,deleted_at=None,display_description='tempest-SnapshotManageAdminTest-Managed-Snapshot-Description-1634961982',display_name='tempest-SnapshotManageAdminTest-Managed-Snapshot-185241695',encryption_key_id=None,group_snapshot=<?>,group_snapshot_id=None,id=dbdbad5c-e25d-446a-a732-4ca9fb26ab61,metadata={manage-snap-meta1='value1',manage-snap-meta2='value2',manage-snap-meta3='value3'},progress='0%',project_id='2e1a470a90914c5184094103834f4da5',provider_auth=None,provider_id=None,provider_location=None,status='creating',updated_at=None,user_id='52194c15c2f14f86b77cf2d53dd38da0',volume=<?>,volume_id=60657fde-7665-44d6-85aa-5a389f44e5aa,volume_size=1,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:23.476950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.CreateSnapshotOnFinishTask;snapshot:manage_existing, manage_existing_snapshot.end' (69541afd-cdee-49a2-8aea-1cc2ca33fe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:23.477957 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Begin to call CreateSnapshotOnFinishTask execute. {{(pid=89244) execute /opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py:285}}
Jan 25 13:15:23.478401 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] New status: available {{(pid=89244) execute /opt/stack/cinder/cinder/volume/flows/manager/manage_existing_snapshot.py:287}}
Jan 25 13:15:23.596583 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.manage_existing_snapshot [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Snapshot dbdbad5c-e25d-446a-a732-4ca9fb26ab61 created successfully.
Jan 25 13:15:23.599497 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Task 'cinder.volume.flows.manager.manage_existing_snapshot.CreateSnapshotOnFinishTask;snapshot:manage_existing, manage_existing_snapshot.end' (69541afd-cdee-49a2-8aea-1cc2ca33fe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:23.604184 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7b217e91-54d3-47f6-8483-c754bb0e66d9 tempest-SnapshotManageAdminTest-1631610768 None] Flow 'snapshot_manage_existing_manager' (a89a131e-5dd0-480e-b4f4-8d654f426c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:23.725967 n-d-760454-3 sudo[115941]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:23.728177 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7" returned: 0 in 0.986s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:23.729385 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:23.761982 n-d-760454-3 sudo[116001]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7
Jan 25 13:15:23.773914 n-d-760454-3 sudo[116001]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:24.635751 n-d-760454-3 sudo[116001]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:24.638529 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7" returned: 0 in 0.908s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:24.641354 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:24.689132 n-d-760454-3 sudo[116030]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7
Jan 25 13:15:24.689891 n-d-760454-3 sudo[116030]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:25.064836 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Lock "b'cinder-dbdbad5c-e25d-446a-a732-4ca9fb26ab61-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:25.255018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:25.300657 n-d-760454-3 sudo[116046]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61
Jan 25 13:15:25.302017 n-d-760454-3 sudo[116046]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:25.663188 n-d-760454-3 sudo[116030]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:25.666127 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7" returned: 0 in 1.024s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:25.667988 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Successfully deleted volume: ef40a4ec-ccd4-4f03-bb76-15756ce23cf7
Jan 25 13:15:25.781683 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Created reservations ['3328cb99-0d2e-4263-b9cc-585dbe977fce', 'f9af6f1f-75f2-4ccf-81c6-6deaf87efc7c', '8c07adf0-cc18-4273-a469-65511fe0cf07', '2c20976c-662e-401b-8feb-aa7227085817'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:25.786110 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:25.786110 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:25.786110 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:26.044518 n-d-760454-3 sudo[116046]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:26.047089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61" returned: 0 in 0.792s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:26.051241 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:26.100440 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:26.101597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:26.112267 n-d-760454-3 sudo[116058]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61
Jan 25 13:15:26.113613 n-d-760454-3 sudo[116058]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:26.148435 n-d-760454-3 sudo[116059]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:26.149445 n-d-760454-3 sudo[116059]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:26.898756 n-d-760454-3 sudo[116059]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:26.901313 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.799s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:26.903765 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:26.961287 n-d-760454-3 sudo[116066]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:26.964042 n-d-760454-3 sudo[116066]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:27.362520 n-d-760454-3 sudo[116058]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:27.384322 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dbdbad5c-e25d-446a-a732-4ca9fb26ab61" returned: 0 in 1.335s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:27.725417 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Lock "b'cinder-321507ac-e3fc-4dc3-9050-0da61246616c-delete_volume'" acquired by "delete_volume" :: waited 0.354s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:28.046413 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Created reservations ['f5c69a20-97f2-4e11-8372-26d2a7b56ea9', 'e4ef6c76-12b6-40c5-ae20-8b634e01068b', 'fb29f950-7759-4fa1-b28e-ad3fc69f3cf7', '72927dda-7c51-4433-866c-4210d50ead8a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:28.049380 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:28.049380 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:28.049380 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:28.066151 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:28.240395 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.177s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:28.240880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 18\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 19\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 20\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:15:28.241664 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Skipping remove_export. No iscsi_target is presently exported for volume: 321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:15:28.248316 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:28.266467 n-d-760454-3 sudo[116066]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:28.276355 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.372s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:28.278229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:28.286764 n-d-760454-3 sudo[116120]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:15:28.296216 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:28.296216 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:28.296216 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:28.306442 n-d-760454-3 sudo[116120]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:28.310801 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Deleted volume successfully.
Jan 25 13:15:28.371191 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-64a0732d-749b-4f39-91f8-11b4c99d9482 tempest-AttachVolumeShelveTestJSON-642976413 None] Lock "b'cinder-ef40a4ec-ccd4-4f03-bb76-15756ce23cf7-delete_volume'" released by "delete_volume" :: held 5.831s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:28.420483 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Delete snapshot completed successfully.
Jan 25 13:15:28.431715 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d7c53213-73cb-4f9f-bd4b-fd8bdc63ae5d tempest-SnapshotManageAdminTest-1631610768 None] Lock "b'cinder-dbdbad5c-e25d-446a-a732-4ca9fb26ab61-delete_snapshot'" released by "delete_snapshot" :: held 3.367s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:28.941004 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Lock "b'cinder-60657fde-7665-44d6-85aa-5a389f44e5aa-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:29.164046 n-d-760454-3 sudo[116120]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:29.177523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c" returned: 0 in 0.933s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:29.180509 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:29.263937 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Skipping remove_export. No iscsi_target is presently exported for volume: 60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:29.271923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:29.277958 n-d-760454-3 sudo[116124]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:15:29.282622 n-d-760454-3 sudo[116124]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:29.341902 n-d-760454-3 sudo[116125]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:29.342877 n-d-760454-3 sudo[116125]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:30.062984 n-d-760454-3 sudo[116125]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:30.065613 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa" returned: 0 in 0.794s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:30.067068 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:30.115656 n-d-760454-3 sudo[116131]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:30.119340 n-d-760454-3 sudo[116131]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:30.250661 n-d-760454-3 sudo[116124]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:30.254831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c" returned: 0 in 1.072s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:30.258762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:30.306575 n-d-760454-3 sudo[116134]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:15:30.307135 n-d-760454-3 sudo[116134]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:30.940887 n-d-760454-3 sudo[116131]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:30.944815 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa" returned: 0 in 0.877s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:30.946853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:30.991281 n-d-760454-3 sudo[116153]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:30.997496 n-d-760454-3 sudo[116153]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:31.086926 n-d-760454-3 sudo[116134]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:31.089338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-321507ac-e3fc-4dc3-9050-0da61246616c" returned: 0 in 0.831s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:31.090441 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Successfully deleted volume: 321507ac-e3fc-4dc3-9050-0da61246616c
Jan 25 13:15:31.232588 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Created reservations ['f88db45d-47a5-4382-89cf-4de59fcd6a67', '60c63056-c2b8-4ffc-8c0f-13ae55bd89b6', '01583bab-cec5-47f3-af0f-581a833087c4', '04763fa2-96c3-406c-813d-41569fa3e5a1'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:31.234131 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:31.234131 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:31.234131 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:31.409688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:31.411182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:31.462174 n-d-760454-3 sudo[116157]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:31.472497 n-d-760454-3 sudo[116157]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:31.875011 n-d-760454-3 sudo[116153]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:31.878442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-60657fde-7665-44d6-85aa-5a389f44e5aa" returned: 0 in 0.931s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:31.882637 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Successfully deleted volume: 60657fde-7665-44d6-85aa-5a389f44e5aa
Jan 25 13:15:32.128570 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Created reservations ['a13de7a7-2efd-4c32-9892-e284b18066dd', 'd4fa8d83-d9d1-4f00-b3b7-9bce7d84a27e', '57a9f87d-904c-4612-beaf-b8a0479335f4', '3961237f-b0f2-4a6b-8a90-047eacc319b8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:32.131051 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:32.131051 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:32.131051 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:32.312886 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:32.313986 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:32.371647 n-d-760454-3 sudo[116166]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:32.380399 n-d-760454-3 sudo[116166]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:32.531611 n-d-760454-3 sudo[116157]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:32.534297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.123s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:32.537058 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:32.578721 n-d-760454-3 sudo[116174]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:32.581138 n-d-760454-3 sudo[116174]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:33.155415 n-d-760454-3 sudo[116166]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:33.158184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.844s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:33.160888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:33.221010 n-d-760454-3 sudo[116185]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:33.236693 n-d-760454-3 sudo[116185]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:33.845691 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:33.852094 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:33.860191 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:33.871801 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (6f5875ae-9102-469e-ac44-25329f7c59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:33.876251 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061c6ca-f96d-4211-97a1-bc21f8dbdb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:33.884714 n-d-760454-3 sudo[116174]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:33.899465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.362s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:33.900843 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:33.905799 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Deleted volume successfully.
Jan 25 13:15:33.908695 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:33.942449 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7061c6ca-f96d-4211-97a1-bc21f8dbdb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1060633870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=ea557777-2492-40b3-ad9e-90266b379767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:34Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:33.951210 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752e7745-aa43-4fd3-bcdd-1f14af0969ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:33.953755 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752e7745-aa43-4fd3-bcdd-1f14af0969ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:33.961953 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4304cdc4-c037-417a-afc6-c462c346a8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:33.970668 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4304cdc4-c037-417a-afc6-c462c346a8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea557777-2492-40b3-ad9e-90266b379767', 'volume_name': 'volume-ea557777-2492-40b3-ad9e-90266b379767', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:33.974088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa5d031-94ba-4ad0-bd16-6e23a1f73480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:33.980009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa5d031-94ba-4ad0-bd16-6e23a1f73480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:33.991214 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c553d70-6d54-48d5-b4b8-57c9a1f48bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:33.992298 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Volume ea557777-2492-40b3-ad9e-90266b379767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea557777-2492-40b3-ad9e-90266b379767', 'volume_size': 1}
Jan 25 13:15:33.993624 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea557777-2492-40b3-ad9e-90266b379767 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:34.029784 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ce3b01c9-8191-4ace-9b32-82bc948e7b7c tempest-AttachVolumeShelveTestJSON-642976413 None] Lock "b'cinder-321507ac-e3fc-4dc3-9050-0da61246616c-delete_volume'" released by "delete_volume" :: held 6.307s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:34.036726 n-d-760454-3 sudo[116189]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea557777-2492-40b3-ad9e-90266b379767 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:34.037729 n-d-760454-3 sudo[116189]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:34.344519 n-d-760454-3 sudo[116185]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:34.346466 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.187s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:34.347605 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:34.353887 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Deleted volume successfully.
Jan 25 13:15:34.408171 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4311ac6f-9d7e-42a1-a0ca-f31fd38b4461 tempest-SnapshotManageAdminTest-134829707 None] Lock "b'cinder-60657fde-7665-44d6-85aa-5a389f44e5aa-delete_volume'" released by "delete_volume" :: held 5.467s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:34.808933 n-d-760454-3 sudo[116189]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:34.811430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea557777-2492-40b3-ad9e-90266b379767 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.817s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:34.819408 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c553d70-6d54-48d5-b4b8-57c9a1f48bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea557777-2492-40b3-ad9e-90266b379767', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:34.823891 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4732da5c-9c62-4fe3-be4a-39ddd314850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:34.879748 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Volume volume-ea557777-2492-40b3-ad9e-90266b379767 (ea557777-2492-40b3-ad9e-90266b379767): created successfully
Jan 25 13:15:34.882903 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4732da5c-9c62-4fe3-be4a-39ddd314850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:34.897763 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (6f5875ae-9102-469e-ac44-25329f7c59f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:34.957163 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ab907aac-8db3-4ba2-b409-1290055b02b3 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:15:35.199983 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a2099277-9855-45bd-a632-25c9c1f383df tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767'" acquired by "attach_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:35.431888 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a2099277-9855-45bd-a632-25c9c1f383df tempest-VolumesActionsTest-1640587457 None] Attaching volume ea557777-2492-40b3-ad9e-90266b379767 to instance 6899ec6d-915c-4965-b9f8-73b67b49cc52 at mountpoint /dev/sdb on host None.
Jan 25 13:15:35.569910 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a2099277-9855-45bd-a632-25c9c1f383df tempest-VolumesActionsTest-1640587457 None] Attach volume completed successfully.
Jan 25 13:15:35.577369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a2099277-9855-45bd-a632-25c9c1f383df tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767'" released by "attach_volume" :: held 0.376s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:35.945011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:15:35.945669 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:35.946855 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:35.989963 n-d-760454-3 sudo[116234]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:36.001775 n-d-760454-3 sudo[116234]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:36.594528 n-d-760454-3 sudo[116234]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:36.597004 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:36.598743 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:36.618399 n-d-760454-3 sudo[116238]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:36.619599 n-d-760454-3 sudo[116238]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:37.587277 n-d-760454-3 sudo[116238]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:37.589543 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.990s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:37.590617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:37.864400 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Terminate volume connection completed successfully.
Jan 25 13:15:37.936032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-detach_volume'" acquired by "detach_volume" :: waited 0.042s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:38.002099 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Detaching volume ea557777-2492-40b3-ad9e-90266b379767 from instance 6899ec6d-915c-4965-b9f8-73b67b49cc52.
Jan 25 13:15:38.003737 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Skipping remove_export. No iscsi_target is presently exported for volume: ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:15:38.237251 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:38.237251 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:38.237251 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:38.271664 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Detach volume completed successfully.
Jan 25 13:15:38.282778 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e1086169-9835-4298-9a0e-f836dd0014db tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-detach_volume'" released by "detach_volume" :: held 0.341s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:38.842833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b0cccbec-0d1d-4769-addd-afcf5b5cefaf tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:38.859202 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b0cccbec-0d1d-4769-addd-afcf5b5cefaf tempest-VolumesActionsTest-1640587457 None] Volume detach called, but volume not attached.
Jan 25 13:15:38.899646 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b0cccbec-0d1d-4769-addd-afcf5b5cefaf tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-detach_volume'" released by "detach_volume" :: held 0.057s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:43.486762 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:43.492229 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:43.493306 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:43.530990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Flow 'volume_create_manager' (c1254b0b-8412-48b7-a4ec-3de523360e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:43.536711 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42a36b3-b418-4f6b-ad34-d1cbb2801da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:43.577774 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:43.615863 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42a36b3-b418-4f6b-ad34-d1cbb2801da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-802491199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=a9989c40-3221-47da-be39-d55d73f6960c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054f9a5ddbcf4895a798f9bce4c8a4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:43Z,user_id='c06c2a73312b4a02a382e1943e13872d',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:43.619211 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd9b24d-c5b1-40e8-8d2b-31ff55ea4aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:43.622375 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd9b24d-c5b1-40e8-8d2b-31ff55ea4aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:43.625357 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2020ab6a-07a4-48b5-8098-a3157901fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:43.628193 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2020ab6a-07a4-48b5-8098-a3157901fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9989c40-3221-47da-be39-d55d73f6960c', 'volume_name': 'volume-a9989c40-3221-47da-be39-d55d73f6960c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:43.632386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89f47f0-8a97-4dc2-a9f9-888c63a97f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:43.635417 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89f47f0-8a97-4dc2-a9f9-888c63a97f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:43.637836 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d29c4e-eb3a-4acb-9791-fdd965cbd6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:43.638916 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Volume a9989c40-3221-47da-be39-d55d73f6960c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9989c40-3221-47da-be39-d55d73f6960c', 'volume_size': 1}
Jan 25 13:15:43.640523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a9989c40-3221-47da-be39-d55d73f6960c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:43.662623 n-d-760454-3 sudo[116269]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a9989c40-3221-47da-be39-d55d73f6960c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:43.663186 n-d-760454-3 sudo[116269]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:44.561774 n-d-760454-3 sudo[116269]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:44.564176 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a9989c40-3221-47da-be39-d55d73f6960c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.923s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:44.568086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d29c4e-eb3a-4acb-9791-fdd965cbd6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9989c40-3221-47da-be39-d55d73f6960c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:44.570794 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b3cbea-990a-4d46-a46e-d9250d53bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:44.614295 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Volume volume-a9989c40-3221-47da-be39-d55d73f6960c (a9989c40-3221-47da-be39-d55d73f6960c): created successfully
Jan 25 13:15:44.617118 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b3cbea-990a-4d46-a46e-d9250d53bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:44.631628 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Flow 'volume_create_manager' (c1254b0b-8412-48b7-a4ec-3de523360e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:44.690911 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fc48668b-7e55-4880-b2e0-91bf160cf369 tempest-VolumesTransfersTest-1854403150 None] Created volume successfully.
Jan 25 13:15:48.122663 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2ad816cd-f3af-4456-a3f0-8843b5ddcaf9 tempest-VolumesTransfersTest-1297481616 None] Transfer volume completed successfully.
Jan 25 13:15:49.393879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:49.401722 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:49.402511 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:49.442734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Flow 'volume_create_manager' (b5339191-61d9-4015-9c2b-009d6485bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:49.448254 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ab6a63-c658-4c5e-a7c9-51c65bd28b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:49.474650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:49.529570 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ab6a63-c658-4c5e-a7c9-51c65bd28b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-415101300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=257a06a9-1f42-4cb2-833d-49a3d7d6719b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e34f232445f644cd974032e15a747b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:49Z,user_id='724ca029a8544120b09a3ae1e26b6232',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:49.541783 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bbe897-c70b-49de-9235-d39c56c1cad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:49.546668 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bbe897-c70b-49de-9235-d39c56c1cad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:49.550635 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bd4471-91e8-44c6-9733-adf72a6dba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:49.556923 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bd4471-91e8-44c6-9733-adf72a6dba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '257a06a9-1f42-4cb2-833d-49a3d7d6719b', 'volume_name': 'volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:49.566925 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0550ca2-6f82-4270-a7d1-d9be8767133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:49.571159 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0550ca2-6f82-4270-a7d1-d9be8767133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:49.582578 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00956ca0-2cfb-4009-ba7f-8c3b745a1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:49.583473 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Volume 257a06a9-1f42-4cb2-833d-49a3d7d6719b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b', 'volume_size': 1}
Jan 25 13:15:49.585291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:49.643492 n-d-760454-3 sudo[116318]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:49.659987 n-d-760454-3 sudo[116318]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:49.948479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:49.954133 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:49.955700 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:49.994049 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (dc636c36-0e7d-4177-adeb-1165001e0bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:49.999936 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6948c1c4-2380-48c7-9bca-a2ef4097ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.039785 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:50.084453 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6948c1c4-2380-48c7-9bca-a2ef4097ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1016855815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=51becaca-48a7-49d8-90d7-91d1e926af05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:50Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.088369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aef61af-8e46-47ee-9cdd-ca2b8a6496e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.091019 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aef61af-8e46-47ee-9cdd-ca2b8a6496e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.094230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d167aea4-d423-4a63-8c26-f99a9ad3f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.126149 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d167aea4-d423-4a63-8c26-f99a9ad3f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51becaca-48a7-49d8-90d7-91d1e926af05', 'volume_name': 'volume-51becaca-48a7-49d8-90d7-91d1e926af05', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.134084 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb22d2-8a04-4cdf-b405-c7ea2ee39ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.140156 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb22d2-8a04-4cdf-b405-c7ea2ee39ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.142880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542b88e2-2a40-4a4f-83ff-f226cc7ae4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.144489 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Volume 51becaca-48a7-49d8-90d7-91d1e926af05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51becaca-48a7-49d8-90d7-91d1e926af05', 'volume_size': 1}
Jan 25 13:15:50.146397 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-51becaca-48a7-49d8-90d7-91d1e926af05 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:50.196301 n-d-760454-3 sudo[116320]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-51becaca-48a7-49d8-90d7-91d1e926af05 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:50.200236 n-d-760454-3 sudo[116320]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:50.222589 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Lock "b'cinder-a9989c40-3221-47da-be39-d55d73f6960c-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:50.711813 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Skipping remove_export. No iscsi_target is presently exported for volume: a9989c40-3221-47da-be39-d55d73f6960c
Jan 25 13:15:50.712654 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:50.767131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.170s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:50.767131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00956ca0-2cfb-4009-ba7f-8c3b745a1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.767131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90ab28-dd49-4db8-ae50-d3c999657d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:50.749450 n-d-760454-3 sudo[116351]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c
Jan 25 13:15:50.749968 n-d-760454-3 sudo[116351]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:50.753076 n-d-760454-3 sudo[116318]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:50.975037 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Volume volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b (257a06a9-1f42-4cb2-833d-49a3d7d6719b): created successfully
Jan 25 13:15:50.977643 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90ab28-dd49-4db8-ae50-d3c999657d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:50.987886 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Flow 'volume_create_manager' (b5339191-61d9-4015-9c2b-009d6485bc73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:51.088974 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c3d03567-d83f-4977-9885-551837426bd2 tempest-SnapshotsActionsTest-1352789598 None] Created volume successfully.
Jan 25 13:15:51.166647 n-d-760454-3 sudo[116320]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:51.169098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-51becaca-48a7-49d8-90d7-91d1e926af05 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.023s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:51.172157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542b88e2-2a40-4a4f-83ff-f226cc7ae4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51becaca-48a7-49d8-90d7-91d1e926af05', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:51.175047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5b69b5-09a6-4cb2-9333-0a93874dc76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:51.236882 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Volume volume-51becaca-48a7-49d8-90d7-91d1e926af05 (51becaca-48a7-49d8-90d7-91d1e926af05): created successfully
Jan 25 13:15:51.239723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5b69b5-09a6-4cb2-9333-0a93874dc76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:51.244932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (dc636c36-0e7d-4177-adeb-1165001e0bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:51.390994 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7c35f94a-754c-4a08-a908-185c68151882 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:15:51.413481 n-d-760454-3 sudo[116351]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:51.417417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c" returned: 0 in 0.704s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:51.422604 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:51.455369 n-d-760454-3 sudo[116383]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c
Jan 25 13:15:51.455978 n-d-760454-3 sudo[116383]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:52.224595 n-d-760454-3 sudo[116383]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:52.226775 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c" returned: 0 in 0.805s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:52.228770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:52.273574 n-d-760454-3 sudo[116387]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c
Jan 25 13:15:52.274800 n-d-760454-3 sudo[116387]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:52.982032 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e44f5bb-f5e6-4ec2-a038-dae984772e1a tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:53.032218 n-d-760454-3 sudo[116396]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:15:53.037762 n-d-760454-3 sudo[116396]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:53.061492 n-d-760454-3 sudo[116387]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:53.064502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a9989c40-3221-47da-be39-d55d73f6960c" returned: 0 in 0.835s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:53.066223 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Successfully deleted volume: a9989c40-3221-47da-be39-d55d73f6960c
Jan 25 13:15:53.179990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Created reservations ['d6366fb3-f317-40c0-9856-5669859d965e', '4055d1ab-9109-4738-a839-39c01aa8ff7c', '1c0a43a8-38ca-43af-ad08-0e93a644a4bb', '5e89819d-05c4-43aa-9497-d9de92fcae6f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:53.183785 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:53.183785 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:53.183785 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:53.387620 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-51becaca-48a7-49d8-90d7-91d1e926af05-delete_volume'" acquired by "delete_volume" :: waited 0.048s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:15:53.414768 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:53.415747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:53.447793 n-d-760454-3 sudo[116398]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:53.449862 n-d-760454-3 sudo[116398]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:53.636186 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Skipping remove_export. No iscsi_target is presently exported for volume: 51becaca-48a7-49d8-90d7-91d1e926af05
Jan 25 13:15:53.637837 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:53.680355 n-d-760454-3 sudo[116402]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05
Jan 25 13:15:53.680997 n-d-760454-3 sudo[116402]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:53.787426 n-d-760454-3 sudo[116396]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:53.790973 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e44f5bb-f5e6-4ec2-a038-dae984772e1a tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 0.815s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:53.793427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e44f5bb-f5e6-4ec2-a038-dae984772e1a tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b5648188-0d1a-454a-8c40-ea33962f0079 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:53.855702 n-d-760454-3 sudo[116404]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b5648188-0d1a-454a-8c40-ea33962f0079 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g
Jan 25 13:15:53.856305 n-d-760454-3 sudo[116404]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:54.356652 n-d-760454-3 sudo[116398]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:54.359931 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.943s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:54.362829 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:54.416211 n-d-760454-3 sudo[116412]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:54.426339 n-d-760454-3 sudo[116412]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:54.562984 n-d-760454-3 sudo[116402]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:54.565902 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05" returned: 0 in 0.927s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:54.567506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:54.639827 n-d-760454-3 sudo[116415]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05
Jan 25 13:15:54.645386 n-d-760454-3 sudo[116415]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:55.579952 n-d-760454-3 sudo[116404]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:55.587637 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e44f5bb-f5e6-4ec2-a038-dae984772e1a tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-b5648188-0d1a-454a-8c40-ea33962f0079 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g" returned: 0 in 1.791s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:55.773201 n-d-760454-3 sudo[116415]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:55.782655 n-d-760454-3 sudo[116412]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:55.790161 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05" returned: 0 in 1.222s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:55.791657 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.430s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:55.794796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:55.822662 n-d-760454-3 sudo[116519]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05
Jan 25 13:15:55.826009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:55.832179 n-d-760454-3 sudo[116519]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:55.836570 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Deleted volume successfully.
Jan 25 13:15:55.906761 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6e44f5bb-f5e6-4ec2-a038-dae984772e1a tempest-SnapshotsActionsTest-1352789598 None] Create snapshot completed successfully
Jan 25 13:15:55.931982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6fee5077-ce31-4b79-9673-dffb4f37a80d tempest-VolumesTransfersTest-754464451 None] Lock "b'cinder-a9989c40-3221-47da-be39-d55d73f6960c-delete_volume'" released by "delete_volume" :: held 5.709s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:56.281367 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:56.320417 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:56.321409 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:56.366260 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Flow 'volume_create_manager' (16ad3364-f036-46c0-8383-29e4f17ff2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:56.389537 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8410e6-1f0e-46cc-8e77-24a4cfa66d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:56.497850 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:56.600310 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8410e6-1f0e-46cc-8e77-24a4cfa66d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-572727804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=7094352c-e925-46d8-9e48-a0d5723b2f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054f9a5ddbcf4895a798f9bce4c8a4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:56Z,user_id='c06c2a73312b4a02a382e1943e13872d',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:56.605932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e7ac1c-c9b0-47e0-9a0b-556faad0f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:56.606697 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e7ac1c-c9b0-47e0-9a0b-556faad0f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:56.609313 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80382e57-5a61-4503-beee-37746f58183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:56.615007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80382e57-5a61-4503-beee-37746f58183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7094352c-e925-46d8-9e48-a0d5723b2f8d', 'volume_name': 'volume-7094352c-e925-46d8-9e48-a0d5723b2f8d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:56.617802 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38077720-97bd-4297-9a82-c230efe369d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:56.620849 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38077720-97bd-4297-9a82-c230efe369d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:56.623257 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b975bf63-bfb9-4399-ba0b-2934a6401e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:56.624652 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Volume 7094352c-e925-46d8-9e48-a0d5723b2f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7094352c-e925-46d8-9e48-a0d5723b2f8d', 'volume_size': 1}
Jan 25 13:15:56.625943 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7094352c-e925-46d8-9e48-a0d5723b2f8d stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:56.674993 n-d-760454-3 sudo[116526]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7094352c-e925-46d8-9e48-a0d5723b2f8d stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:56.680017 n-d-760454-3 sudo[116526]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:56.806782 n-d-760454-3 sudo[116519]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:56.809476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-51becaca-48a7-49d8-90d7-91d1e926af05" returned: 0 in 1.015s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:56.811049 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Successfully deleted volume: 51becaca-48a7-49d8-90d7-91d1e926af05
Jan 25 13:15:56.957382 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Created reservations ['55b0ab18-212a-4d15-bdac-1325bb02ac57', 'db5d5d55-ce2b-443f-a89a-3c903aca8afa', '147bde65-33a2-43ae-8ba6-da2c20f36119', '8f120f6c-d917-4634-961c-88acbe2f2d4b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:15:56.960326 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:15:56.960326 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:15:56.960326 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:15:57.088640 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:15:57.089721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:57.131547 n-d-760454-3 sudo[116531]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:15:57.132113 n-d-760454-3 sudo[116531]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:57.341819 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:57.355905 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:57.355905 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:57.394277 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Flow 'volume_create_manager' (820e31df-3d8d-4e76-91c1-0bfc73e33283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:57.398070 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace7a36-0e6b-48f1-8943-30f84200e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.467614 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:57.529158 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace7a36-0e6b-48f1-8943-30f84200e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1752652099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=31cb2356-e527-4a4f-ba10-f0d689e67d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bdf96948c04d97a1d2a00304814903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:57Z,user_id='275e05e45de2426e99dd135e2362dc27',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.543400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c1c2fe-d744-4a5f-9dbc-5c1fe5bf8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.566291 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c1c2fe-d744-4a5f-9dbc-5c1fe5bf8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.570800 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ba2443-d286-4efb-b2cf-5862020b0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.579252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ba2443-d286-4efb-b2cf-5862020b0677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cb2356-e527-4a4f-ba10-f0d689e67d66', 'volume_name': 'volume-31cb2356-e527-4a4f-ba10-f0d689e67d66', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.589659 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bbcda3-2974-44b9-8d52-59a7711fbfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.592275 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bbcda3-2974-44b9-8d52-59a7711fbfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.599160 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f281f5e-2b91-4110-8daa-a31a8084593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.600245 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Volume 31cb2356-e527-4a4f-ba10-f0d689e67d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cb2356-e527-4a4f-ba10-f0d689e67d66', 'volume_size': 1}
Jan 25 13:15:57.601486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:57.644793 n-d-760454-3 sudo[116563]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:57.645694 n-d-760454-3 sudo[116526]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:57.648372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7094352c-e925-46d8-9e48-a0d5723b2f8d stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.022s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:57.652167 n-d-760454-3 sudo[116563]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:57.652895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b975bf63-bfb9-4399-ba0b-2934a6401e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7094352c-e925-46d8-9e48-a0d5723b2f8d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.656047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c172a0a3-715e-4a0d-a2ac-5192db2b562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:57.769146 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Volume volume-7094352c-e925-46d8-9e48-a0d5723b2f8d (7094352c-e925-46d8-9e48-a0d5723b2f8d): created successfully
Jan 25 13:15:57.772437 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c172a0a3-715e-4a0d-a2ac-5192db2b562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:57.776447 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Flow 'volume_create_manager' (16ad3364-f036-46c0-8383-29e4f17ff2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:57.845989 n-d-760454-3 sudo[116531]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:57.847751 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.758s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:57.849613 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:57.896009 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-38ef1d36-9686-4736-b2d1-3696f200c582 tempest-VolumesTransfersTest-1854403150 None] Created volume successfully.
Jan 25 13:15:57.897883 n-d-760454-3 sudo[116567]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:15:57.904693 n-d-760454-3 sudo[116567]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:58.543958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-240876e0-c837-4ffa-95c5-9ca8287b57e7 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:58.544799 n-d-760454-3 sudo[116563]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:58.580231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.978s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:58.585087 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f281f5e-2b91-4110-8daa-a31a8084593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cb2356-e527-4a4f-ba10-f0d689e67d66', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:58.588333 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00583b91-2953-4e72-a065-c63a2ef67fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:58.588737 n-d-760454-3 sudo[116601]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:15:58.589296 n-d-760454-3 sudo[116601]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:58.694536 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Volume volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 (31cb2356-e527-4a4f-ba10-f0d689e67d66): created successfully
Jan 25 13:15:58.697387 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00583b91-2953-4e72-a065-c63a2ef67fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:58.702010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Flow 'volume_create_manager' (820e31df-3d8d-4e76-91c1-0bfc73e33283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:58.785818 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-3cc3ec4c-9a3f-4c94-88b3-1eb28765b7d6 req-40a9f891-18f0-4c40-86ad-a8333be31ef6 tempest-VolumesSnapshotsTestJSON-881403277 None] Created volume successfully.
Jan 25 13:15:58.845987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:15:58.852375 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:15:58.857089 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:15:58.868265 n-d-760454-3 sudo[116567]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:58.896334 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (81426b9e-d660-4383-a5d2-1bff5427a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:15:58.916427 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854a3129-dee5-42a3-a934-5f394aeffbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:58.964988 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.116s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:58.969791 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:15:58.993175 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Deleted volume successfully.
Jan 25 13:15:59.003919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:15:59.048042 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854a3129-dee5-42a3-a934-5f394aeffbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2124690566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:15:59Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:59.052710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e846a-7626-4f48-8dc2-5b1d64c24d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:59.056910 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e846a-7626-4f48-8dc2-5b1d64c24d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:59.061438 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24fb9bc-a27d-43fd-a083-08f61788f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:59.064447 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24fb9bc-a27d-43fd-a083-08f61788f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6', 'volume_name': 'volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:59.068379 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b2c94-385a-4b32-a39f-d2a15dc75b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:59.076850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b2c94-385a-4b32-a39f-d2a15dc75b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:15:59.079743 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833de6a9-93bb-4588-a89b-75e60bff2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:15:59.081055 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Volume e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6', 'volume_size': 1}
Jan 25 13:15:59.082860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:59.105880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3b03a94f-3b5b-44a8-9d34-3d54ab1dc592 tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-51becaca-48a7-49d8-90d7-91d1e926af05-delete_volume'" released by "delete_volume" :: held 5.718s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:15:59.112359 n-d-760454-3 sudo[116604]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:15:59.113008 n-d-760454-3 sudo[116604]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:15:59.479487 n-d-760454-3 sudo[116601]: pam_unix(sudo:session): session closed for user root
Jan 25 13:15:59.481927 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-240876e0-c837-4ffa-95c5-9ca8287b57e7 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 0.938s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:15:59.482782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-240876e0-c837-4ffa-95c5-9ca8287b57e7 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:15:59.524764 n-d-760454-3 sudo[116609]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g
Jan 25 13:15:59.527127 n-d-760454-3 sudo[116609]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:00.143392 n-d-760454-3 sudo[116604]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:00.146546 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.064s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:00.155403 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833de6a9-93bb-4588-a89b-75e60bff2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:00.161958 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abb479f-96dc-43cc-8e43-7fd66464eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:00.195797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Lock "b'cinder-7094352c-e925-46d8-9e48-a0d5723b2f8d-delete_volume'" acquired by "delete_volume" :: waited 0.051s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:00.245996 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Volume volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 (e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6): created successfully
Jan 25 13:16:00.245996 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abb479f-96dc-43cc-8e43-7fd66464eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:00.252195 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (81426b9e-d660-4383-a5d2-1bff5427a366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:00.341034 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ac947b78-b948-428d-a05a-981373593a79 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:16:00.365136 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Skipping remove_export. No iscsi_target is presently exported for volume: 7094352c-e925-46d8-9e48-a0d5723b2f8d
Jan 25 13:16:00.366026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:00.428116 n-d-760454-3 sudo[116665]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d
Jan 25 13:16:00.431741 n-d-760454-3 sudo[116665]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:00.739627 n-d-760454-3 sudo[116609]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:00.742284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-240876e0-c837-4ffa-95c5-9ca8287b57e7 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g" returned: 0 in 1.260s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:00.883119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4112df3c-fd4c-40fa-a095-3fe0da436fb8 req-f5d0d40c-67ed-44b3-bb35-e7df7af6674b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:00.944232 n-d-760454-3 sudo[116747]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:00.945140 n-d-760454-3 sudo[116747]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:01.007778 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-240876e0-c837-4ffa-95c5-9ca8287b57e7 tempest-SnapshotsActionsTest-1352789598 None] Create snapshot completed successfully
Jan 25 13:16:01.384060 n-d-760454-3 sudo[116665]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:01.386225 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d" returned: 0 in 1.020s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:01.387800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:01.449738 n-d-760454-3 sudo[116751]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d
Jan 25 13:16:01.450332 n-d-760454-3 sudo[116751]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:02.062493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:02.143991 n-d-760454-3 sudo[116747]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:02.207853 n-d-760454-3 sudo[116751]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:02.216676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d" returned: 0 in 0.829s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:02.217302 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4112df3c-fd4c-40fa-a095-3fe0da436fb8 req-f5d0d40c-67ed-44b3-bb35-e7df7af6674b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66" returned: 0 in 1.334s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:02.230468 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Skipping remove_export. No iscsi_target is presently exported for volume: e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6
Jan 25 13:16:02.231691 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:02.267470 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:02.283128 n-d-760454-3 sudo[116757]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6
Jan 25 13:16:02.284019 n-d-760454-3 sudo[116757]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:02.298380 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4112df3c-fd4c-40fa-a095-3fe0da436fb8 req-f5d0d40c-67ed-44b3-bb35-e7df7af6674b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335 --snapshot stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:02.322001 n-d-760454-3 sudo[116758]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d
Jan 25 13:16:02.327350 n-d-760454-3 sudo[116758]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:02.333562 n-d-760454-3 sudo[116760]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335 --snapshot stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 -L 1.00g
Jan 25 13:16:02.334702 n-d-760454-3 sudo[116760]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:02.466952 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-d7de83f5-4833-4a43-a8ea-9070621b8ecd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:02.472892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:02.528146 n-d-760454-3 sudo[116763]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd
Jan 25 13:16:02.535849 n-d-760454-3 sudo[116763]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:03.129776 n-d-760454-3 sudo[116758]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:03.132701 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7094352c-e925-46d8-9e48-a0d5723b2f8d" returned: 0 in 0.865s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:03.134251 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Successfully deleted volume: 7094352c-e925-46d8-9e48-a0d5723b2f8d
Jan 25 13:16:03.301228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Created reservations ['50a0a11a-e08c-49bd-82ca-a158baf29378', '4e8a4e54-8c35-4256-9f89-11238f69b17a', '8b52f575-24a8-4bc8-bea7-8923de01787f', '9125def4-53ff-4f28-b7c1-5dbe5d203f3d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:03.303255 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:03.303255 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:03.303255 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:03.334556 n-d-760454-3 sudo[116757]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:03.336758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6" returned: 0 in 1.105s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:03.337887 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:03.394164 n-d-760454-3 sudo[116763]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:03.402219 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd" returned: 0 in 0.928s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:03.410792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:03.426232 n-d-760454-3 sudo[116790]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6
Jan 25 13:16:03.427511 n-d-760454-3 sudo[116790]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:03.480053 n-d-760454-3 sudo[116801]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd
Jan 25 13:16:03.492837 n-d-760454-3 sudo[116801]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:03.625771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:03.629962 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:03.673040 n-d-760454-3 sudo[116871]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:03.673595 n-d-760454-3 sudo[116871]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:03.757489 n-d-760454-3 sudo[116760]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:03.760375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-4112df3c-fd4c-40fa-a095-3fe0da436fb8 req-f5d0d40c-67ed-44b3-bb35-e7df7af6674b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335 --snapshot stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 -L 1.00g" returned: 0 in 1.462s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:03.934099 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-4112df3c-fd4c-40fa-a095-3fe0da436fb8 req-f5d0d40c-67ed-44b3-bb35-e7df7af6674b tempest-VolumesSnapshotsTestJSON-881403277 None] Create snapshot completed successfully
Jan 25 13:16:04.258625 n-d-760454-3 sudo[116790]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:04.261400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6" returned: 0 in 0.923s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:04.264126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:04.288750 n-d-760454-3 sudo[116883]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6
Jan 25 13:16:04.289857 n-d-760454-3 sudo[116883]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:04.402788 n-d-760454-3 sudo[116871]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:04.405362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:04.408338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:04.440854 n-d-760454-3 sudo[116887]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:04.442257 n-d-760454-3 sudo[116887]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:04.858506 n-d-760454-3 sudo[116801]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:04.861920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-d7de83f5-4833-4a43-a8ea-9070621b8ecd" returned: 0 in 1.455s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:05.129572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Created reservations ['431afbe8-5b92-4ba2-b434-f554f4b2bb6d', '30a53ba7-6dc1-469e-931e-7c683da18517', 'd448d7f0-1387-4620-b2e5-c5ef7361d624', '20e6d240-ff67-4348-9be4-ab60d3700800'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:05.131928 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:05.131928 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:05.131928 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:05.212100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Lock "b'cinder-1cbcfc8e-d82a-4650-acc3-91962f181335-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:05.222211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:05.308881 n-d-760454-3 sudo[116950]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335
Jan 25 13:16:05.309679 n-d-760454-3 sudo[116950]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:05.370081 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Delete snapshot completed successfully.
Jan 25 13:16:05.390879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a29d8915-2c40-47ac-b573-e440b05df856 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-d7de83f5-4833-4a43-a8ea-9070621b8ecd-delete_snapshot'" released by "delete_snapshot" :: held 2.921s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:05.464320 n-d-760454-3 sudo[116883]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:05.468401 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6" returned: 0 in 1.205s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:05.471342 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Successfully deleted volume: e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6
Jan 25 13:16:05.648716 n-d-760454-3 sudo[116887]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:05.651297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.243s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:05.652853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:05.675153 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Deleted volume successfully.
Jan 25 13:16:05.695481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Created reservations ['02dcad95-0d57-4994-a18b-f747522c83d3', '34726dbe-ff8f-4070-b148-be56cf686bd2', '940dcaa8-0e51-4955-8bfe-a7b35862dc37', '7b8a41f3-ea77-49fd-837a-d61a6c492676'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:05.699115 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:05.699115 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:05.699115 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:05.785999 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-39f3590f-2d94-44bc-b86b-73add1b4c8d4 tempest-VolumesTransfersTest-754464451 None] Lock "b'cinder-7094352c-e925-46d8-9e48-a0d5723b2f8d-delete_volume'" released by "delete_volume" :: held 5.595s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:05.967053 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:05.967053 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:05.999121 n-d-760454-3 sudo[116956]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:06.001459 n-d-760454-3 sudo[116956]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:06.108973 n-d-760454-3 sudo[116950]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:06.114842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335" returned: 0 in 0.891s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:06.117816 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:06.149816 n-d-760454-3 sudo[116958]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335
Jan 25 13:16:06.150370 n-d-760454-3 sudo[116958]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:06.821738 n-d-760454-3 sudo[116956]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:06.825208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.866s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:06.827517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:06.875404 n-d-760454-3 sudo[116962]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:06.876635 n-d-760454-3 sudo[116962]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:07.406845 n-d-760454-3 sudo[116958]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:07.411809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-1cbcfc8e-d82a-4650-acc3-91962f181335" returned: 0 in 1.293s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:07.850069 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-69a3d137-a5da-4783-8c17-b5ca006fd908 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:07.898186 n-d-760454-3 sudo[117008]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:07.899048 n-d-760454-3 sudo[117008]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:08.001578 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:08.011484 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:08.013481 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:08.061104 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (b12ec9be-7448-40c9-bd20-e7c9b2933190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:08.086754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba85def9-af5a-4fc6-bb8a-12969ce67eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:08.157264 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Created reservations ['c59d2ef3-0741-4ee9-9b8f-e15e94dbed63', '0023e53e-e1df-4f35-ac59-35715f47c11a', 'dc2c4c5a-e316-4655-bf37-d12adc1c2586', '7699832e-d58e-494f-a2fd-856278f23f0f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:08.160903 n-d-760454-3 sudo[116962]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:08.170305 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:08.170305 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:08.170305 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:08.174928 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.347s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:08.181785 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:08.200839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:08.210135 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Deleted volume successfully.
Jan 25 13:16:08.299178 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba85def9-af5a-4fc6-bb8a-12969ce67eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864496534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=bdfab83d-fc3d-4824-af00-5564bc8ef59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:08Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:08.304930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6dc73d-df1d-40eb-b0f2-5e877cc60be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:08.310152 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6dc73d-df1d-40eb-b0f2-5e877cc60be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:08.315541 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a5f0fe-3d96-4163-ac53-71519dee2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:08.321761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a5f0fe-3d96-4163-ac53-71519dee2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdfab83d-fc3d-4824-af00-5564bc8ef59e', 'volume_name': 'volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:08.326801 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ae2653-6b7a-46b3-9f82-350a1a507ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:08.331845 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ae2653-6b7a-46b3-9f82-350a1a507ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:08.338118 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4454ed8-6f66-4233-b7da-d54317aa41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:08.340474 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Volume bdfab83d-fc3d-4824-af00-5564bc8ef59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e', 'volume_size': 1}
Jan 25 13:16:08.342762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:08.384606 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:08.384606 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:08.384606 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:08.406722 n-d-760454-3 sudo[117011]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:08.407570 n-d-760454-3 sudo[117011]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:08.449866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-86407be0-7104-4ae5-b7e2-5c068c4ea474 tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-e31eb85b-d7ba-4b6c-9ee6-74a86fe1a9a6-delete_volume'" released by "delete_volume" :: held 6.388s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:08.631588 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Delete snapshot completed successfully.
Jan 25 13:16:08.653950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-8e28c795-2ee5-467f-823c-8adcbadd6718 req-06897fe5-c9ba-4cee-8102-eb7e74430d8e tempest-VolumesSnapshotsTestJSON-881403277 None] Lock "b'cinder-1cbcfc8e-d82a-4650-acc3-91962f181335-delete_snapshot'" released by "delete_snapshot" :: held 3.434s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:08.988150 n-d-760454-3 sudo[117008]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:08.991092 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-69a3d137-a5da-4783-8c17-b5ca006fd908 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 1.142s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:08.993104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-69a3d137-a5da-4783-8c17-b5ca006fd908 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:09.069903 n-d-760454-3 sudo[117015]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g
Jan 25 13:16:09.072141 n-d-760454-3 sudo[117015]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:09.524161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Lock "b'cinder-31cb2356-e527-4a4f-ba10-f0d689e67d66-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:09.961005 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Skipping remove_export. No iscsi_target is presently exported for volume: 31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:09.962419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:10.104219 n-d-760454-3 sudo[117034]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:10.109009 n-d-760454-3 sudo[117034]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:10.211752 n-d-760454-3 sudo[117011]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:10.217651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.873s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:10.225108 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4454ed8-6f66-4233-b7da-d54317aa41ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:10.234761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc5a03c-666e-4897-be2d-44f593610f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:10.310093 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Volume volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e (bdfab83d-fc3d-4824-af00-5564bc8ef59e): created successfully
Jan 25 13:16:10.315550 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc5a03c-666e-4897-be2d-44f593610f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:10.331616 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (b12ec9be-7448-40c9-bd20-e7c9b2933190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:10.391500 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-19923d24-2ad0-4ae7-b2bb-24373d048666 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:16:11.177317 n-d-760454-3 sudo[117015]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:11.179752 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-69a3d137-a5da-4783-8c17-b5ca006fd908 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g" returned: 0 in 2.187s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:11.339463 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-69a3d137-a5da-4783-8c17-b5ca006fd908 tempest-SnapshotsActionsTest-1352789598 None] Create snapshot completed successfully
Jan 25 13:16:11.466875 n-d-760454-3 sudo[117034]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:11.470031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66" returned: 0 in 1.508s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:11.471542 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:11.495153 n-d-760454-3 sudo[117158]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:11.496328 n-d-760454-3 sudo[117158]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:11.763565 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-bdfab83d-fc3d-4824-af00-5564bc8ef59e-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:11.952658 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Skipping remove_export. No iscsi_target is presently exported for volume: bdfab83d-fc3d-4824-af00-5564bc8ef59e
Jan 25 13:16:11.954253 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:11.997651 n-d-760454-3 sudo[117160]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e
Jan 25 13:16:11.998410 n-d-760454-3 sudo[117160]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:12.502105 n-d-760454-3 sudo[117158]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:12.505973 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66" returned: 0 in 1.034s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:12.510265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:12.537337 n-d-760454-3 sudo[117164]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:12.538037 n-d-760454-3 sudo[117164]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:12.839644 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-fbe46f45-30c9-4831-b1be-b64f79dfbb5b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:12.842419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:12.926911 n-d-760454-3 sudo[117169]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b
Jan 25 13:16:12.931689 n-d-760454-3 sudo[117169]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:12.936349 n-d-760454-3 sudo[117160]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:12.939723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e" returned: 0 in 0.985s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:12.941500 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:12.972873 n-d-760454-3 sudo[117172]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e
Jan 25 13:16:12.981125 n-d-760454-3 sudo[117172]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:13.253157 n-d-760454-3 sudo[117164]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:13.255860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-31cb2356-e527-4a4f-ba10-f0d689e67d66" returned: 0 in 0.747s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:13.257517 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Successfully deleted volume: 31cb2356-e527-4a4f-ba10-f0d689e67d66
Jan 25 13:16:13.368714 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Created reservations ['e263cc57-a913-49c0-91a2-a6df761c3b1e', '92a511c1-007a-4b26-b124-b52e69ffc089', '40b8f05f-b938-4d8a-8e58-9001ad3f9388', 'd1097e8c-514d-4fd4-9bb6-c581f55d3308'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:13.371594 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:13.371594 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:13.371594 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:13.522207 n-d-760454-3 sudo[117172]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:13.524190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e" returned: 0 in 0.583s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:13.525442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:13.541112 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:13.542133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:13.552846 n-d-760454-3 sudo[117184]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e
Jan 25 13:16:13.553853 n-d-760454-3 sudo[117184]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:13.574076 n-d-760454-3 sudo[117185]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:13.575811 n-d-760454-3 sudo[117185]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:13.756859 n-d-760454-3 sudo[117169]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:13.760442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b" returned: 0 in 0.917s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:13.763279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:13.810868 n-d-760454-3 sudo[117188]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b
Jan 25 13:16:13.811523 n-d-760454-3 sudo[117188]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:14.158038 n-d-760454-3 sudo[117185]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:14.160732 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:14.162631 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:14.184209 n-d-760454-3 sudo[117200]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:14.185369 n-d-760454-3 sudo[117200]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:14.409001 n-d-760454-3 sudo[117184]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:14.413195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bdfab83d-fc3d-4824-af00-5564bc8ef59e" returned: 0 in 0.886s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:14.416336 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Successfully deleted volume: bdfab83d-fc3d-4824-af00-5564bc8ef59e
Jan 25 13:16:14.556613 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Created reservations ['bc162216-3a56-4128-b44b-00f557574e3e', '91de8102-bc0b-483f-a34e-963ea0d4a27a', '8e0014c9-b52b-43de-a5db-1134f58a882e', 'e83817f6-b812-4415-9c16-b30e719bccc8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:14.559325 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:14.559325 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:14.559325 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:14.716622 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:14.717414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:14.790580 n-d-760454-3 sudo[117233]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:14.791190 n-d-760454-3 sudo[117233]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:15.140217 n-d-760454-3 sudo[117188]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:15.144890 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-fbe46f45-30c9-4831-b1be-b64f79dfbb5b" returned: 0 in 1.381s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:15.272167 n-d-760454-3 sudo[117200]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:15.282214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.119s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:15.284324 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:15.315842 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Deleted volume successfully.
Jan 25 13:16:15.362116 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-5570220c-ffce-4145-865c-82027d029295 req-25382fd9-c818-491f-aa35-5d4d3361144b tempest-VolumesSnapshotsTestJSON-881403277 None] Lock "b'cinder-31cb2356-e527-4a4f-ba10-f0d689e67d66-delete_volume'" released by "delete_volume" :: held 5.838s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:15.385105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Created reservations ['94b85b52-e7e2-48b5-b58e-d59977a8cdca', 'd1a24970-7eb9-47c8-8b5d-46cc7a1ac582', '54841e2e-759e-4c75-ad36-949349e20fa5', '7f035adc-016b-4d91-9746-bcdfffc54b43'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:15.387846 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:15.387846 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:15.387846 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:15.468320 n-d-760454-3 sudo[117233]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:15.470242 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.753s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:15.471805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:15.490496 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Delete snapshot completed successfully.
Jan 25 13:16:15.492692 n-d-760454-3 sudo[117267]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:15.493719 n-d-760454-3 sudo[117267]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:15.498403 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-11f2f834-1d30-4772-a318-50b5646e3414 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-fbe46f45-30c9-4831-b1be-b64f79dfbb5b-delete_snapshot'" released by "delete_snapshot" :: held 2.659s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:16.325500 n-d-760454-3 sudo[117267]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:16.327432 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.855s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:16.332211 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:16.342842 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Deleted volume successfully.
Jan 25 13:16:16.406563 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-2ab1a7ce-1866-42d8-8fc6-3eb30fefa22d tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-bdfab83d-fc3d-4824-af00-5564bc8ef59e-delete_volume'" released by "delete_volume" :: held 4.640s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:16.521353 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:16.531525 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:16.534211 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:16.562586 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (a8bb04d0-4c71-4630-84c9-7afea7a129bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:16.569528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f7c83-0078-478f-ad69-18a9333e3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:16.609806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:16.646384 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916f7c83-0078-478f-ad69-18a9333e3c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052330923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=76916f3b-e494-4c6d-930c-07f4257a5a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:16Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:16.651363 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1270ab-c605-4c6e-9902-8429dde0e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:16.654764 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1270ab-c605-4c6e-9902-8429dde0e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:16.658430 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d5f89d-1412-4516-ae5b-566cf8cdf5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:16.662362 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d5f89d-1412-4516-ae5b-566cf8cdf5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76916f3b-e494-4c6d-930c-07f4257a5a36', 'volume_name': 'volume-76916f3b-e494-4c6d-930c-07f4257a5a36', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:16.665366 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917b9c85-5fa7-4dbd-8f23-e76dd8347e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:16.667840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917b9c85-5fa7-4dbd-8f23-e76dd8347e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:16.670683 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89014d5e-0141-442f-9514-3edd9457e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:16.671908 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Volume 76916f3b-e494-4c6d-930c-07f4257a5a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76916f3b-e494-4c6d-930c-07f4257a5a36', 'volume_size': 1}
Jan 25 13:16:16.674108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-76916f3b-e494-4c6d-930c-07f4257a5a36 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:16.696202 n-d-760454-3 sudo[117271]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-76916f3b-e494-4c6d-930c-07f4257a5a36 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:16.697807 n-d-760454-3 sudo[117271]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:17.400002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a053714-9109-4932-961f-b6e255ba9d8d tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:17.467341 n-d-760454-3 sudo[117294]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:17.469340 n-d-760454-3 sudo[117294]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:17.522763 n-d-760454-3 sudo[117271]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:17.530448 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-76916f3b-e494-4c6d-930c-07f4257a5a36 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.851s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:17.536262 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89014d5e-0141-442f-9514-3edd9457e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76916f3b-e494-4c6d-930c-07f4257a5a36', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:17.544290 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4db654-20f8-4ae4-91f7-27b5fdd3723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:17.596037 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Volume volume-76916f3b-e494-4c6d-930c-07f4257a5a36 (76916f3b-e494-4c6d-930c-07f4257a5a36): created successfully
Jan 25 13:16:17.600404 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4db654-20f8-4ae4-91f7-27b5fdd3723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:17.602504 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (a8bb04d0-4c71-4630-84c9-7afea7a129bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:17.636790 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7c9e2031-9378-491b-b639-157b7975f332 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:16:18.303996 n-d-760454-3 sudo[117294]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:18.306162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a053714-9109-4932-961f-b6e255ba9d8d tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 0.907s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:18.307867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a053714-9109-4932-961f-b6e255ba9d8d tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-bde6e01f-748b-4954-8598-9c43380b4830 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:18.353132 n-d-760454-3 sudo[117306]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-bde6e01f-748b-4954-8598-9c43380b4830 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g
Jan 25 13:16:18.353733 n-d-760454-3 sudo[117306]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:19.634145 n-d-760454-3 sudo[117306]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:19.637913 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a053714-9109-4932-961f-b6e255ba9d8d tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-bde6e01f-748b-4954-8598-9c43380b4830 --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g" returned: 0 in 1.330s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:19.766485 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-76916f3b-e494-4c6d-930c-07f4257a5a36-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:19.781919 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7a053714-9109-4932-961f-b6e255ba9d8d tempest-SnapshotsActionsTest-1352789598 None] Create snapshot completed successfully
Jan 25 13:16:19.913072 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Skipping remove_export. No iscsi_target is presently exported for volume: 76916f3b-e494-4c6d-930c-07f4257a5a36
Jan 25 13:16:19.914297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:19.963969 n-d-760454-3 sudo[117415]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36
Jan 25 13:16:19.967626 n-d-760454-3 sudo[117415]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:20.598831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:20.605353 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:20.607382 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:20.700610 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Flow 'volume_create_manager' (428ae941-dcab-4eae-af20-ab36c8ff7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:20.707981 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beacbf4f-372f-49df-93ef-4a293bd7326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:20.786290 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:20.837170 n-d-760454-3 sudo[117415]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:20.877751 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beacbf4f-372f-49df-93ef-4a293bd7326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1834138819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=83ba78d6-e40b-4768-adb0-9f61fe881260,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec286e305739445599e009bbfc5f1dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:20Z,user_id='26a3d1ccdce24d1ab339e28db44b1d3a',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:20.881037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1001f760-efa5-4e57-9dc9-a176c63f0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:20.883817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1001f760-efa5-4e57-9dc9-a176c63f0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:20.897661 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50abe66f-8a88-4773-a2f5-9b01b9729567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:20.910498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50abe66f-8a88-4773-a2f5-9b01b9729567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ba78d6-e40b-4768-adb0-9f61fe881260', 'volume_name': 'volume-83ba78d6-e40b-4768-adb0-9f61fe881260', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:20.914899 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbf509e-23aa-4ffe-9422-ceefe6448535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:20.917409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbf509e-23aa-4ffe-9422-ceefe6448535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:20.930504 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09677aaa-df74-4951-ac73-00c84953df77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:20.942081 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Volume 83ba78d6-e40b-4768-adb0-9f61fe881260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ba78d6-e40b-4768-adb0-9f61fe881260', 'volume_size': 1}
Jan 25 13:16:20.942081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-83ba78d6-e40b-4768-adb0-9f61fe881260 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:20.953943 n-d-760454-3 sudo[117419]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-83ba78d6-e40b-4768-adb0-9f61fe881260 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:20.954535 n-d-760454-3 sudo[117419]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:20.955495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36" returned: 0 in 1.038s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:20.956979 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:21.011938 n-d-760454-3 sudo[117421]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36
Jan 25 13:16:21.012782 n-d-760454-3 sudo[117421]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:21.635183 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-bde6e01f-748b-4954-8598-9c43380b4830-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:21.638626 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:21.660899 n-d-760454-3 sudo[117439]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830
Jan 25 13:16:21.662027 n-d-760454-3 sudo[117439]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:21.864130 n-d-760454-3 sudo[117421]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:21.873600 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36" returned: 0 in 0.910s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:21.874641 n-d-760454-3 sudo[117419]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:21.897190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:21.940426 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-83ba78d6-e40b-4768-adb0-9f61fe881260 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.006s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:21.944768 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09677aaa-df74-4951-ac73-00c84953df77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ba78d6-e40b-4768-adb0-9f61fe881260', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:21.958175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872c8e9b-915d-4817-a5b2-2f8ccd536385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:21.971942 n-d-760454-3 sudo[117456]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36
Jan 25 13:16:21.973201 n-d-760454-3 sudo[117456]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:22.019248 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Volume volume-83ba78d6-e40b-4768-adb0-9f61fe881260 (83ba78d6-e40b-4768-adb0-9f61fe881260): created successfully
Jan 25 13:16:22.021727 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872c8e9b-915d-4817-a5b2-2f8ccd536385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:22.025899 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Flow 'volume_create_manager' (428ae941-dcab-4eae-af20-ab36c8ff7285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:22.089181 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-c3dbe82d-07c0-487a-9614-0a546e1d880d req-eb10595a-cc89-4f38-a899-9da02a3d8fdc tempest-VolumesGetTestJSON-1686783857 None] Created volume successfully.
Jan 25 13:16:22.272656 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:22.279221 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:22.279978 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:22.335049 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Flow 'volume_create_manager' (e1f16ba5-c55f-457e-97c9-02305415f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:22.342585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229cbec-702b-41ef-9eb2-121e6db324c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:22.422805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:22.479610 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229cbec-702b-41ef-9eb2-121e6db324c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-669781384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=f78fad85-32b3-4c14-9de1-1781f62f2b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ebb93b22bf41fbb1b322fcfb2ba396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:22Z,user_id='0d5e5b3a314045ee9e186216149803cd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:22.486241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a32f94-3670-43bc-aa65-3ea56dd4a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:22.492875 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a32f94-3670-43bc-aa65-3ea56dd4a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:22.502514 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45739b27-3873-4f5d-8114-15f538fe6df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:22.508236 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45739b27-3873-4f5d-8114-15f538fe6df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78fad85-32b3-4c14-9de1-1781f62f2b51', 'volume_name': 'volume-f78fad85-32b3-4c14-9de1-1781f62f2b51', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:22.520960 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d17d06-4863-42b9-a680-de7f6f01d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:22.525405 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d17d06-4863-42b9-a680-de7f6f01d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:22.528128 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf6698-c1b7-46d2-acf3-ca1efd3ee385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:22.530918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Volume f78fad85-32b3-4c14-9de1-1781f62f2b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78fad85-32b3-4c14-9de1-1781f62f2b51', 'volume_size': 1}
Jan 25 13:16:22.532602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:22.555320 n-d-760454-3 sudo[117460]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:22.556676 n-d-760454-3 sudo[117460]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:22.821083 n-d-760454-3 sudo[117439]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:22.824980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830" returned: 0 in 1.186s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:22.827222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:22.875164 n-d-760454-3 sudo[117456]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:22.878083 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-76916f3b-e494-4c6d-930c-07f4257a5a36" returned: 0 in 0.984s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:22.880014 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Successfully deleted volume: 76916f3b-e494-4c6d-930c-07f4257a5a36
Jan 25 13:16:22.882093 n-d-760454-3 sudo[117470]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830
Jan 25 13:16:22.883308 n-d-760454-3 sudo[117470]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:23.139788 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Created reservations ['eba9c053-2272-4964-9abc-dbc97fc5659a', 'f7b10c25-78e9-449b-a4a1-4e1c501c10d8', '87eaf73c-3646-49b1-a839-624c1ac19dd2', '07218c42-322c-4ff9-90f5-6e848eebb2d2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:23.153959 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:23.153959 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:23.153959 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:23.275795 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Lock "b'cinder-83ba78d6-e40b-4768-adb0-9f61fe881260-delete_volume'" acquired by "delete_volume" :: waited 0.168s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:23.516796 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:23.516796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:23.548642 n-d-760454-3 sudo[117474]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:23.562348 n-d-760454-3 sudo[117474]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:23.576624 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Skipping remove_export. No iscsi_target is presently exported for volume: 83ba78d6-e40b-4768-adb0-9f61fe881260
Jan 25 13:16:23.578545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:23.604022 n-d-760454-3 sudo[117477]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260
Jan 25 13:16:23.605485 n-d-760454-3 sudo[117477]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:23.936468 n-d-760454-3 sudo[117460]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:23.943945 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.411s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:23.956381 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf6698-c1b7-46d2-acf3-ca1efd3ee385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78fad85-32b3-4c14-9de1-1781f62f2b51', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:23.976001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f5aaa-5a00-4570-9c41-b7fae6447cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:24.054888 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Volume volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 (f78fad85-32b3-4c14-9de1-1781f62f2b51): created successfully
Jan 25 13:16:24.059235 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f5aaa-5a00-4570-9c41-b7fae6447cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:24.070797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Flow 'volume_create_manager' (e1f16ba5-c55f-457e-97c9-02305415f81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:24.149856 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d3b4e35a-b720-4f77-b80b-8617f4c6ceb4 tempest-VolumesActionsTest-540514637 None] Created volume successfully.
Jan 25 13:16:24.264427 n-d-760454-3 sudo[117470]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:24.267719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-bde6e01f-748b-4954-8598-9c43380b4830" returned: 0 in 1.440s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:24.590489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Created reservations ['058b00bc-d555-4539-9488-24ee0ca37534', '6c02f7d9-33fe-4a4b-99bf-0390651b6ac1', '0b0d27ce-96ab-4f25-b53d-dbc159d903ae', 'c62454c3-8e70-41b8-ae1f-4ad391396aef'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:24.592332 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:24.592332 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:24.592332 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:24.756475 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Delete snapshot completed successfully.
Jan 25 13:16:24.766122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-acaa83ad-4400-4ca8-adcd-c69fc26d730b tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-bde6e01f-748b-4954-8598-9c43380b4830-delete_snapshot'" released by "delete_snapshot" :: held 3.131s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:24.949978 n-d-760454-3 sudo[117474]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:24.952358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.438s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:24.953797 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:25.023117 n-d-760454-3 sudo[117477]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:25.026187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260" returned: 0 in 1.447s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:25.027951 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:25.036265 n-d-760454-3 sudo[117568]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:25.036939 n-d-760454-3 sudo[117568]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:25.091848 n-d-760454-3 sudo[117569]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260
Jan 25 13:16:25.121881 n-d-760454-3 sudo[117569]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:25.753097 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:25.759865 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:25.762666 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:25.810244 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (5f79d090-e092-4ef0-8be0-f94bf47112c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:25.827925 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065397cc-f8c9-4b5a-842f-56211c36eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:25.965446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:26.042870 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065397cc-f8c9-4b5a-842f-56211c36eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-542292994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c7c677b663d48eca230c765e5d0c596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:26Z,user_id='af9aa081e18e4406ad9ec693152ecd13',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:26.047997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7b2de7-6fe8-46b3-8dd9-a1f82c29f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:26.055790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7b2de7-6fe8-46b3-8dd9-a1f82c29f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:26.073236 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d07867a-b615-488f-bcc3-8eea7d4862c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:26.079928 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d07867a-b615-488f-bcc3-8eea7d4862c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9', 'volume_name': 'volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:26.083132 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ba23af-9005-49fd-968b-a3e067072a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:26.099526 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ba23af-9005-49fd-968b-a3e067072a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:26.102086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7d87f8-0cfd-4468-804f-c7a93e74c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:26.103012 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Volume 4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9', 'volume_size': 1}
Jan 25 13:16:26.104293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:26.166778 n-d-760454-3 sudo[117574]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:26.169400 n-d-760454-3 sudo[117574]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:26.433308 n-d-760454-3 sudo[117568]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:26.435772 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.481s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:26.437630 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:26.469658 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Deleted volume successfully.
Jan 25 13:16:26.637306 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-27f88300-e3b2-4249-9da7-60f4acf7aaec tempest-VolumesActionsTest-1361626184 None] Lock "b'cinder-76916f3b-e494-4c6d-930c-07f4257a5a36-delete_volume'" released by "delete_volume" :: held 6.871s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:26.647905 n-d-760454-3 sudo[117569]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:26.656058 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260" returned: 0 in 1.628s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:26.662279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:26.752916 n-d-760454-3 sudo[117578]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260
Jan 25 13:16:26.756071 n-d-760454-3 sudo[117578]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:27.677670 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5a69a722-af61-4a64-8123-d0d39bcc843c tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:27.737759 n-d-760454-3 sudo[117597]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:27.741753 n-d-760454-3 sudo[117597]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:27.986966 n-d-760454-3 sudo[117574]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:27.989531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.885s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:27.994724 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7d87f8-0cfd-4468-804f-c7a93e74c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:27.997764 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4eea41-56c0-4b32-891b-8c3f9ad73836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:28.059712 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Volume volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 (4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9): created successfully
Jan 25 13:16:28.062862 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4eea41-56c0-4b32-891b-8c3f9ad73836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:28.068984 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Flow 'volume_create_manager' (5f79d090-e092-4ef0-8be0-f94bf47112c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:28.127588 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b7efed97-84f5-4636-a815-b8b3611f1386 tempest-VolumesActionsTest-1640587457 None] Created volume successfully.
Jan 25 13:16:28.214819 n-d-760454-3 sudo[117578]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:28.217247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-83ba78d6-e40b-4768-adb0-9f61fe881260" returned: 0 in 1.555s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:28.218536 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Successfully deleted volume: 83ba78d6-e40b-4768-adb0-9f61fe881260
Jan 25 13:16:28.339876 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Created reservations ['3b404bbd-5122-4ac2-a5d7-68a306dc24cc', '44736193-6e61-48e7-b32b-42f7de317cf4', '9c4f5abb-abb8-4a9b-979e-03c2279c1da0', '460da879-b917-437c-b9ec-e0cc7e131cae'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:28.344061 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:28.344061 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:28.344061 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:28.544565 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:28.545495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:28.596953 n-d-760454-3 sudo[117619]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:28.597574 n-d-760454-3 sudo[117619]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:28.897145 n-d-760454-3 sudo[117597]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:28.899543 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5a69a722-af61-4a64-8123-d0d39bcc843c tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 1.222s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:28.900714 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5a69a722-af61-4a64-8123-d0d39bcc843c tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:28.943566 n-d-760454-3 sudo[117623]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g
Jan 25 13:16:28.948977 n-d-760454-3 sudo[117623]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:29.663357 n-d-760454-3 sudo[117619]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:29.666154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.120s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:29.668226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:29.694284 n-d-760454-3 sudo[117627]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:29.695369 n-d-760454-3 sudo[117627]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:30.884274 n-d-760454-3 sudo[117627]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:30.886803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.218s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:30.888693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:30.901618 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Deleted volume successfully.
Jan 25 13:16:30.911297 n-d-760454-3 sudo[117623]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:30.916079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5a69a722-af61-4a64-8123-d0d39bcc843c tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b --snapshot stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b -L 1.00g" returned: 0 in 2.015s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:30.974713 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-6fe9723f-2f40-4ac6-aeec-1f2340247bde req-816b84d4-6e64-449c-bbaf-8a31f1428c5f tempest-VolumesGetTestJSON-1686783857 None] Lock "b'cinder-83ba78d6-e40b-4768-adb0-9f61fe881260-delete_volume'" released by "delete_volume" :: held 7.699s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:31.167293 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5a69a722-af61-4a64-8123-d0d39bcc843c tempest-SnapshotsActionsTest-1352789598 None] Create snapshot completed successfully
Jan 25 13:16:32.832853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:33.082081 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Skipping remove_export. No iscsi_target is presently exported for volume: 4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9
Jan 25 13:16:33.083453 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:33.110078 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-79b1cf03-aabd-4e2f-849d-1c7291556a8b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.078s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:33.112715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:33.125453 n-d-760454-3 sudo[117738]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9
Jan 25 13:16:33.126834 n-d-760454-3 sudo[117738]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:33.186070 n-d-760454-3 sudo[117739]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b
Jan 25 13:16:33.186641 n-d-760454-3 sudo[117739]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:34.604890 n-d-760454-3 sudo[117739]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:34.607323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b" returned: 0 in 1.494s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:34.610971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:34.648920 n-d-760454-3 sudo[117748]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b
Jan 25 13:16:34.650102 n-d-760454-3 sudo[117748]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:34.896845 n-d-760454-3 sudo[117738]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:34.899204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9" returned: 0 in 1.815s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:34.900427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:34.949059 n-d-760454-3 sudo[117750]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9
Jan 25 13:16:34.949667 n-d-760454-3 sudo[117750]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:35.751242 n-d-760454-3 sudo[117748]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:35.754427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79b1cf03-aabd-4e2f-849d-1c7291556a8b" returned: 0 in 1.143s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:35.949851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:16:35.950661 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:35.951540 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:35.977345 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Created reservations ['f26cb7b0-4716-40af-9014-055c36e863a2', '47bc4219-336b-4c53-a4fb-c98ea63e779c', '3f98c353-23b9-422d-99aa-e64290682ed4', '58718693-2c7e-41ae-b4ed-84672952600c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:35.982972 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:35.982972 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:35.982972 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:36.009873 n-d-760454-3 sudo[117810]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:36.019488 n-d-760454-3 sudo[117810]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:36.091567 n-d-760454-3 sudo[117750]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:36.099642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9" returned: 0 in 1.199s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:36.102733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:36.147578 n-d-760454-3 sudo[117813]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9
Jan 25 13:16:36.150040 n-d-760454-3 sudo[117813]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:36.220175 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Delete snapshot completed successfully.
Jan 25 13:16:36.229514 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4628cff8-281f-4644-b182-0b23d47ef201 tempest-SnapshotsActionsTest-1722576210 None] Lock "b'cinder-79b1cf03-aabd-4e2f-849d-1c7291556a8b-delete_snapshot'" released by "delete_snapshot" :: held 3.120s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:36.950307 n-d-760454-3 sudo[117810]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:36.952218 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.001s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:36.955680 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:36.988603 n-d-760454-3 sudo[117819]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:36.991417 n-d-760454-3 sudo[117819]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:37.345182 n-d-760454-3 sudo[117813]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:37.347475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9" returned: 0 in 1.244s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:37.349046 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Successfully deleted volume: 4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9
Jan 25 13:16:37.493337 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Created reservations ['9c8d532e-6a2b-4b32-9956-029d275b9c3e', '2b259fcf-e91a-4273-af8a-46af2aac7f1f', 'ebaae756-1bf9-4b89-b406-0bed2e593d91', '69907721-7ddb-4297-86d4-3201e7096fb0'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:37.496094 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:37.496094 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:37.496094 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:37.761334 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:37.762536 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:37.768005 n-d-760454-3 sudo[117819]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:37.792738 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:37.794481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:37.811778 n-d-760454-3 sudo[117828]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:37.812387 n-d-760454-3 sudo[117828]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:38.483408 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:38.493318 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:38.495763 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:38.547703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (db3ceee3-9955-4326-9375-91ac24cb3ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:38.547703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d432b5f8-f873-4ac0-8d77-159e1f71f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:38.605481 n-d-760454-3 sudo[117828]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:38.614216 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.852s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:38.630180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:38.660277 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:38.677797 n-d-760454-3 sudo[117832]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:38.688930 n-d-760454-3 sudo[117832]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:38.731945 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d432b5f8-f873-4ac0-8d77-159e1f71f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-11085353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=690df0b3-d4dc-4b51-8dac-27356d85d21e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08eea995374b35b1eefd350bbbf3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:38Z,user_id='c0c0683f91414834982af0575973aa2c',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:38.748173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74aca46b-7cdd-40be-83f2-a4a0599bcbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:38.755416 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74aca46b-7cdd-40be-83f2-a4a0599bcbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:38.764079 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc9adaa-6761-4ec4-8680-235d62c53a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:38.770550 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc9adaa-6761-4ec4-8680-235d62c53a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690df0b3-d4dc-4b51-8dac-27356d85d21e', 'volume_name': 'volume-690df0b3-d4dc-4b51-8dac-27356d85d21e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:38.787257 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a14fad-f9d8-4857-9962-7b288dcda6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:38.790746 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a14fad-f9d8-4857-9962-7b288dcda6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:38.800730 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bc4849-c301-400f-a689-213200dc87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:38.817399 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Volume 690df0b3-d4dc-4b51-8dac-27356d85d21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690df0b3-d4dc-4b51-8dac-27356d85d21e', 'volume_size': 1}
Jan 25 13:16:38.819210 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-690df0b3-d4dc-4b51-8dac-27356d85d21e stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:38.894976 n-d-760454-3 sudo[117834]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-690df0b3-d4dc-4b51-8dac-27356d85d21e stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:38.897067 n-d-760454-3 sudo[117834]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:39.258440 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Lock "b'cinder-b5648188-0d1a-454a-8c40-ea33962f0079-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:39.277455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:39.362093 n-d-760454-3 sudo[117836]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079
Jan 25 13:16:39.362734 n-d-760454-3 sudo[117836]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:39.367201 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:39.616636 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Skipping remove_export. No iscsi_target is presently exported for volume: ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:16:39.623311 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:39.668073 n-d-760454-3 sudo[117839]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:16:39.683511 n-d-760454-3 sudo[117839]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:39.975808 n-d-760454-3 sudo[117832]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:39.978436 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.362s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:39.980514 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:39.993330 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Deleted volume successfully.
Jan 25 13:16:40.041604 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-422dea84-9ae2-40e5-8e7f-96d9af88f8aa tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-4d0f3f1f-b84d-4e84-bbc8-2adb2cdc35a9-delete_volume'" released by "delete_volume" :: held 7.208s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:40.100643 n-d-760454-3 sudo[117836]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:40.102433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079" returned: 0 in 0.825s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:40.104446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:40.141949 n-d-760454-3 sudo[117857]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079
Jan 25 13:16:40.149878 n-d-760454-3 sudo[117857]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:40.276159 n-d-760454-3 sudo[117834]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:40.279097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-690df0b3-d4dc-4b51-8dac-27356d85d21e stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:40.283680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bc4849-c301-400f-a689-213200dc87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690df0b3-d4dc-4b51-8dac-27356d85d21e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:40.289081 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b41483e-06aa-4636-8274-5f10cedfe571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:40.345371 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Volume volume-690df0b3-d4dc-4b51-8dac-27356d85d21e (690df0b3-d4dc-4b51-8dac-27356d85d21e): created successfully
Jan 25 13:16:40.347785 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b41483e-06aa-4636-8274-5f10cedfe571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:40.351371 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (db3ceee3-9955-4326-9375-91ac24cb3ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:40.418649 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8ccccc01-bc1d-4d40-8991-1ca1b0fe560a tempest-VolumesTestJSON-690575906 None] Created volume successfully.
Jan 25 13:16:40.687271 n-d-760454-3 sudo[117839]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:40.693667 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767" returned: 0 in 1.067s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:40.693667 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:40.728401 n-d-760454-3 sudo[117877]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:16:40.729050 n-d-760454-3 sudo[117877]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:41.121941 n-d-760454-3 sudo[117857]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:41.124452 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-b5648188-0d1a-454a-8c40-ea33962f0079" returned: 0 in 1.019s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:41.413437 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Created reservations ['25d7bf32-478b-44a7-a3ca-e1ded608ba66', '34654849-2e3b-4ca8-8b2f-46395da55393', '59244ca8-7c48-4bfb-b207-f43883c25d4b', 'd51dc5ae-d662-496e-8ef3-5ec7fbdee079'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:41.415408 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:41.415408 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:41.415408 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:41.607171 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Delete snapshot completed successfully.
Jan 25 13:16:41.621019 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8011927d-d28e-443e-9e4a-129b2c69071c tempest-SnapshotsActionsTest-1352789598 None] Lock "b'cinder-b5648188-0d1a-454a-8c40-ea33962f0079-delete_snapshot'" released by "delete_snapshot" :: held 2.363s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:41.725950 n-d-760454-3 sudo[117877]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:41.727965 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767" returned: 0 in 1.037s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:41.729454 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:41.780112 n-d-760454-3 sudo[117919]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:16:41.785206 n-d-760454-3 sudo[117919]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:41.952618 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Lock "b'cinder-257a06a9-1f42-4cb2-833d-49a3d7d6719b-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:42.132524 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Skipping remove_export. No iscsi_target is presently exported for volume: 257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:42.133798 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:42.165447 n-d-760454-3 sudo[117921]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:42.166679 n-d-760454-3 sudo[117921]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:42.884027 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:42.889297 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:42.889857 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:42.933638 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (3e61b8cb-4629-49d2-9210-85eea7986275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:42.961318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb357a3-5be3-4e64-84c9-80ae4b1c2136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:43.043964 n-d-760454-3 sudo[117919]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:43.104066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea557777-2492-40b3-ad9e-90266b379767" returned: 0 in 1.374s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:43.111338 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Successfully deleted volume: ea557777-2492-40b3-ad9e-90266b379767
Jan 25 13:16:43.152122 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:43.421006 n-d-760454-3 sudo[117921]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:43.425532 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 1.292s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:43.431343 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb357a3-5be3-4e64-84c9-80ae4b1c2136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1936906364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=84debef9-2cc9-46ad-bbc5-350811ca0d38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08eea995374b35b1eefd350bbbf3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:43Z,user_id='c0c0683f91414834982af0575973aa2c',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:43.434989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3b6664-ca1c-4916-891b-6bdb0910fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:43.441536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3b6664-ca1c-4916-891b-6bdb0910fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:43.442734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2397725-3594-4093-8e46-74ac6554fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:43.446693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2397725-3594-4093-8e46-74ac6554fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84debef9-2cc9-46ad-bbc5-350811ca0d38', 'volume_name': 'volume-84debef9-2cc9-46ad-bbc5-350811ca0d38', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:43.452386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba940951-3a4a-49d8-bc35-a422a847eaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:43.457913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba940951-3a4a-49d8-bc35-a422a847eaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:43.473368 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93a9a9c-3d96-400c-b57a-2df0e424322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:43.475853 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Volume 84debef9-2cc9-46ad-bbc5-350811ca0d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84debef9-2cc9-46ad-bbc5-350811ca0d38', 'volume_size': 1}
Jan 25 13:16:43.475853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:43.511696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:43.546239 n-d-760454-3 sudo[117933]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:43.548231 n-d-760454-3 sudo[117933]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:43.649030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Created reservations ['86afd30f-da93-44ae-ada2-7b36d56c5782', 'f581ecb3-558a-4c4c-a529-e1fdc0439887', 'd4d455cd-96d7-4e90-98b8-7a1951c3908d', '7610c673-d1c1-49d7-8eef-77992a15bcd0'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:43.652968 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:43.652968 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:43.652968 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:43.661363 n-d-760454-3 sudo[117934]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:43.661922 n-d-760454-3 sudo[117934]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:44.098311 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:44.099332 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:44.144253 n-d-760454-3 sudo[117939]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:44.149799 n-d-760454-3 sudo[117939]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:44.206674 n-d-760454-3 sudo[117934]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:44.209367 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 0.698s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:44.212098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:44.259861 n-d-760454-3 sudo[117944]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:44.260509 n-d-760454-3 sudo[117944]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:44.682471 n-d-760454-3 sudo[117933]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:44.686908 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.209s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:44.689592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93a9a9c-3d96-400c-b57a-2df0e424322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84debef9-2cc9-46ad-bbc5-350811ca0d38', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:44.692117 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c549c9b-8a53-4ea9-a60a-499cb675eb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:44.761259 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Volume volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 (84debef9-2cc9-46ad-bbc5-350811ca0d38): created successfully
Jan 25 13:16:44.763776 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c549c9b-8a53-4ea9-a60a-499cb675eb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:44.767993 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (3e61b8cb-4629-49d2-9210-85eea7986275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:44.812583 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-61b064dd-87ac-4d25-9239-134911f4331f tempest-VolumesTestJSON-690575906 None] Created volume successfully.
Jan 25 13:16:45.305620 n-d-760454-3 sudo[117944]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:45.307594 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-257a06a9-1f42-4cb2-833d-49a3d7d6719b" returned: 0 in 1.096s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:45.308579 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Successfully deleted volume: 257a06a9-1f42-4cb2-833d-49a3d7d6719b
Jan 25 13:16:45.315334 n-d-760454-3 sudo[117939]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:45.318832 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.220s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:45.320275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:45.362274 n-d-760454-3 sudo[117983]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:45.363495 n-d-760454-3 sudo[117983]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:45.505140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Created reservations ['c32303c7-7809-40f4-866a-dd7e2e3a55f4', '38a80d35-39df-4f93-a256-2f1f17e10d2d', '77628ecb-825f-4e76-9ec6-6f635fc8542f', 'c48ce218-6841-430b-9387-e5f28ef12f28'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:45.507774 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:45.507774 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:45.507774 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:45.652546 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:45.654066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:45.699519 n-d-760454-3 sudo[117985]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:45.702753 n-d-760454-3 sudo[117985]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:46.191296 n-d-760454-3 sudo[117983]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:46.193928 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.873s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:46.196759 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:46.204090 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Deleted volume successfully.
Jan 25 13:16:46.263039 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a0b13fe3-8efb-4229-869c-28a4e13f20ea tempest-VolumesActionsTest-1640587457 None] Lock "b'cinder-ea557777-2492-40b3-ad9e-90266b379767-delete_volume'" released by "delete_volume" :: held 6.896s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:46.331930 n-d-760454-3 sudo[117985]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:46.334278 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:46.335879 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:46.379877 n-d-760454-3 sudo[117991]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:46.380471 n-d-760454-3 sudo[117991]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:47.387804 n-d-760454-3 sudo[117991]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:47.397770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.062s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:47.399188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:47.414701 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Deleted volume successfully.
Jan 25 13:16:47.443725 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:47.449286 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:47.457744 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:47.490757 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (08523999-b0b4-43d6-be5b-c8767fa3945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:47.500251 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93be49b8-8067-4adb-8986-7c0572a55f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:47.561447 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:47.564793 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-67e04950-39eb-4050-8d24-3ef012dbc627 tempest-SnapshotsActionsTest-1352789598 None] Lock "b'cinder-257a06a9-1f42-4cb2-833d-49a3d7d6719b-delete_volume'" released by "delete_volume" :: held 5.612s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:47.608251 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93be49b8-8067-4adb-8986-7c0572a55f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1091794467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=0e0b7702-5e85-4222-979a-75ec0665e914,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b08eea995374b35b1eefd350bbbf3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:47Z,user_id='c0c0683f91414834982af0575973aa2c',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:47.612915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c306377-f779-4826-9aac-aab8d6f4523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:47.616659 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c306377-f779-4826-9aac-aab8d6f4523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:47.620147 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84575d82-6b03-4386-969c-ace7ff20626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:47.624955 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84575d82-6b03-4386-969c-ace7ff20626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0b7702-5e85-4222-979a-75ec0665e914', 'volume_name': 'volume-0e0b7702-5e85-4222-979a-75ec0665e914', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:47.628252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c24a7c-5ab8-46d9-83c9-dd2c366283a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:47.631792 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c24a7c-5ab8-46d9-83c9-dd2c366283a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:47.635621 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5447de5c-e550-4334-b86c-f856d3c3b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:47.636711 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Volume 0e0b7702-5e85-4222-979a-75ec0665e914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0b7702-5e85-4222-979a-75ec0665e914', 'volume_size': 1}
Jan 25 13:16:47.637982 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0e0b7702-5e85-4222-979a-75ec0665e914 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:47.684350 n-d-760454-3 sudo[117995]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0e0b7702-5e85-4222-979a-75ec0665e914 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:47.691531 n-d-760454-3 sudo[117995]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:48.639161 n-d-760454-3 sudo[117995]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:48.642187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0e0b7702-5e85-4222-979a-75ec0665e914 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.003s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:48.646738 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5447de5c-e550-4334-b86c-f856d3c3b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0b7702-5e85-4222-979a-75ec0665e914', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:48.649704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91346434-029c-41ff-a337-a11a82ea1295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:48.710404 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Volume volume-0e0b7702-5e85-4222-979a-75ec0665e914 (0e0b7702-5e85-4222-979a-75ec0665e914): created successfully
Jan 25 13:16:48.713559 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91346434-029c-41ff-a337-a11a82ea1295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:48.717214 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Flow 'volume_create_manager' (08523999-b0b4-43d6-be5b-c8767fa3945c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:48.761298 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7f796ae9-28c9-4ed4-99fa-a942a179db9e tempest-VolumesTestJSON-690575906 None] Created volume successfully.
Jan 25 13:16:52.848920 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-0e0b7702-5e85-4222-979a-75ec0665e914-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:52.975661 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Skipping remove_export. No iscsi_target is presently exported for volume: 0e0b7702-5e85-4222-979a-75ec0665e914
Jan 25 13:16:52.976575 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:52.995304 n-d-760454-3 sudo[118026]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914
Jan 25 13:16:52.996454 n-d-760454-3 sudo[118026]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:53.564283 n-d-760454-3 sudo[118026]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:53.566651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914" returned: 0 in 0.590s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:53.567881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:53.589433 n-d-760454-3 sudo[118030]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914
Jan 25 13:16:53.590617 n-d-760454-3 sudo[118030]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:54.238302 n-d-760454-3 sudo[118030]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:54.241564 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914" returned: 0 in 0.673s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:54.246990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:54.304897 n-d-760454-3 sudo[118036]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914
Jan 25 13:16:54.306534 n-d-760454-3 sudo[118036]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:54.947926 n-d-760454-3 sudo[118036]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:54.950388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0e0b7702-5e85-4222-979a-75ec0665e914" returned: 0 in 0.703s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:54.951681 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Successfully deleted volume: 0e0b7702-5e85-4222-979a-75ec0665e914
Jan 25 13:16:55.059604 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Created reservations ['84010cc3-a489-453e-bf33-5022ee85de46', 'c0ebdcab-8169-4f2e-8330-bda1f50caa10', '94256c72-b1ae-4fb7-8559-fbff9604ecfb', '8be7fbcd-9ad0-45e3-b2fa-7a4f0ff246b8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:55.062934 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:55.062934 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:55.062934 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:55.224263 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:55.225712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:55.244706 n-d-760454-3 sudo[118045]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:55.245384 n-d-760454-3 sudo[118045]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:55.818896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-84debef9-2cc9-46ad-bbc5-350811ca0d38-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:55.825897 n-d-760454-3 sudo[118045]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:55.841336 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:55.843295 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:55.903338 n-d-760454-3 sudo[118049]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:55.910906 n-d-760454-3 sudo[118049]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:56.172831 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Skipping remove_export. No iscsi_target is presently exported for volume: 84debef9-2cc9-46ad-bbc5-350811ca0d38
Jan 25 13:16:56.174398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:56.215813 n-d-760454-3 sudo[118051]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38
Jan 25 13:16:56.216894 n-d-760454-3 sudo[118051]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:56.871002 n-d-760454-3 sudo[118049]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:56.874293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.030s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:56.877478 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:16:56.885579 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Deleted volume successfully.
Jan 25 13:16:56.962322 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8c7112d1-8307-47a2-8f5a-6ae817e87973 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-0e0b7702-5e85-4222-979a-75ec0665e914-delete_volume'" released by "delete_volume" :: held 4.113s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:57.012980 n-d-760454-3 sudo[118051]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:57.018179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38" returned: 0 in 0.844s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:57.019157 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:57.111084 n-d-760454-3 sudo[118066]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38
Jan 25 13:16:57.111653 n-d-760454-3 sudo[118066]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:57.653285 n-d-760454-3 sudo[118066]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:57.655601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38" returned: 0 in 0.636s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:57.658273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:57.687839 n-d-760454-3 sudo[118090]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38
Jan 25 13:16:57.689044 n-d-760454-3 sudo[118090]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:57.778311 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-69ec9a1a-5b7e-46b0-94fb-b203cb4def2f tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51'" acquired by "attach_volume" :: waited 0.024s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:57.990249 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-69ec9a1a-5b7e-46b0-94fb-b203cb4def2f tempest-VolumesActionsTest-540514637 None] Attaching volume f78fad85-32b3-4c14-9de1-1781f62f2b51 to instance 6bb03368-81e5-4791-8363-43c25809502a at mountpoint /dev/sdb on host None.
Jan 25 13:16:58.181446 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-69ec9a1a-5b7e-46b0-94fb-b203cb4def2f tempest-VolumesActionsTest-540514637 None] Attach volume completed successfully.
Jan 25 13:16:58.188332 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-69ec9a1a-5b7e-46b0-94fb-b203cb4def2f tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51'" released by "attach_volume" :: held 0.410s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:58.327299 n-d-760454-3 sudo[118090]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:58.334121 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-84debef9-2cc9-46ad-bbc5-350811ca0d38" returned: 0 in 0.672s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:58.334121 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Successfully deleted volume: 84debef9-2cc9-46ad-bbc5-350811ca0d38
Jan 25 13:16:58.435583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Created reservations ['53827f25-30b3-4dea-aa89-cb40516cd22f', '0d3c12a9-4f7f-428f-8a3c-4fab040b9973', 'a3ec1de9-d0e7-453f-9949-37a78fda4775', '5ed02c18-54f2-4107-8d42-e35fba94edff'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:16:58.438674 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:58.438674 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:58.438674 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:58.485591 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:58.485591 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:58.485591 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:58.516309 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-detach_volume'" acquired by "detach_volume" :: waited 0.037s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:58.539415 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] Detaching volume f78fad85-32b3-4c14-9de1-1781f62f2b51 from instance 6bb03368-81e5-4791-8363-43c25809502a.
Jan 25 13:16:58.540179 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] Skipping remove_export. No iscsi_target is presently exported for volume: f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:16:58.710136 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:16:58.710136 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:16:58.710136 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:16:58.767227 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:16:58.768047 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:58.814773 n-d-760454-3 sudo[118120]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:16:58.817734 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] Detach volume completed successfully.
Jan 25 13:16:58.829869 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-2206c051-4233-4083-a20a-a995fa82d6d6 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-detach_volume'" released by "detach_volume" :: held 0.314s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:16:58.830031 n-d-760454-3 sudo[118120]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:59.128771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:16:59.134589 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:16:59.135149 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:16:59.180265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (80ab8b67-3fb4-4af0-803c-c1642964f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:16:59.187300 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98155fe-11c0-4353-9441-78fd78285100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:59.253311 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:16:59.315195 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98155fe-11c0-4353-9441-78fd78285100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-755855997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=2738a648-cb8b-43c3-846d-8d473f6ef6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74560616a00e405986ff2d9fb162d4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:16:59Z,user_id='892cfa816bb14aa08ef5cb99b580efa5',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:59.320376 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e03a9ad-22b7-4e6a-80a8-199eb887b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:59.328208 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e03a9ad-22b7-4e6a-80a8-199eb887b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:59.330846 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e11448-7cc5-4d4c-80e2-1255c82afa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:59.348142 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e11448-7cc5-4d4c-80e2-1255c82afa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2738a648-cb8b-43c3-846d-8d473f6ef6e1', 'volume_name': 'volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:59.350747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f1e7ad-ca13-48f4-bf9f-968aceddebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:59.369174 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f1e7ad-ca13-48f4-bf9f-968aceddebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:16:59.371644 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4ef8a-70b8-4ec4-b373-76a3abeb0357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:16:59.378077 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Volume 2738a648-cb8b-43c3-846d-8d473f6ef6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1', 'volume_size': 1}
Jan 25 13:16:59.379298 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:59.424359 n-d-760454-3 sudo[118123]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:16:59.431882 n-d-760454-3 sudo[118123]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:59.442326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-690df0b3-d4dc-4b51-8dac-27356d85d21e-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:16:59.610850 n-d-760454-3 sudo[118120]: pam_unix(sudo:session): session closed for user root
Jan 25 13:16:59.623737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.856s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:16:59.631573 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:59.681945 n-d-760454-3 sudo[118134]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:16:59.682492 n-d-760454-3 sudo[118134]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:16:59.712561 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Skipping remove_export. No iscsi_target is presently exported for volume: 690df0b3-d4dc-4b51-8dac-27356d85d21e
Jan 25 13:16:59.713750 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:16:59.742092 n-d-760454-3 sudo[118138]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e
Jan 25 13:16:59.743456 n-d-760454-3 sudo[118138]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:00.791248 n-d-760454-3 sudo[118134]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:00.795657 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.162s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:00.798940 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:00.814247 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Deleted volume successfully.
Jan 25 13:17:00.879770 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c9d11b39-8326-42b3-9dee-6e4df9bfc6f8 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-84debef9-2cc9-46ad-bbc5-350811ca0d38-delete_volume'" released by "delete_volume" :: held 5.062s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:00.913042 n-d-760454-3 sudo[118138]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:00.914091 n-d-760454-3 sudo[118123]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:00.914864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e" returned: 0 in 1.201s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:00.915904 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:00.955439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.576s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:00.960265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b4ef8a-70b8-4ec4-b373-76a3abeb0357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:00.967598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb725909-84da-4845-88b8-6f16dd2460ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:00.968317 n-d-760454-3 sudo[118193]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e
Jan 25 13:17:00.968966 n-d-760454-3 sudo[118193]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:01.018583 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Volume volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 (2738a648-cb8b-43c3-846d-8d473f6ef6e1): created successfully
Jan 25 13:17:01.020686 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb725909-84da-4845-88b8-6f16dd2460ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:01.023941 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (80ab8b67-3fb4-4af0-803c-c1642964f63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:01.078233 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-937f5bf7-9322-4f4c-8993-3a67014aa152 tempest-VolumesDeleteCascade-1946341496 None] Created volume successfully.
Jan 25 13:17:01.457195 n-d-760454-3 sudo[118193]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:01.458992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e" returned: 0 in 0.543s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:01.462091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:01.499551 n-d-760454-3 sudo[118197]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e
Jan 25 13:17:01.500572 n-d-760454-3 sudo[118197]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:02.525581 n-d-760454-3 sudo[118197]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:02.528045 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-690df0b3-d4dc-4b51-8dac-27356d85d21e" returned: 0 in 1.066s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:02.529291 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Successfully deleted volume: 690df0b3-d4dc-4b51-8dac-27356d85d21e
Jan 25 13:17:02.615690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f56814e9-37a9-40c8-a0d4-e85211ceea3d tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:02.657163 n-d-760454-3 sudo[118209]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:02.663258 n-d-760454-3 sudo[118209]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:02.716057 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Created reservations ['3d6b2292-8af1-4889-b2d1-2ea7723a9c4a', 'c40fbbcc-0b0e-496c-a41c-d4315657018c', '5538ed9a-2faa-4703-9f06-fcfa40511752', '300e2770-cff0-4565-8bbb-99f93a05cdf1'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:02.718626 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:02.718626 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:02.718626 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:02.897874 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:02.898720 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:02.940201 n-d-760454-3 sudo[118211]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:02.951145 n-d-760454-3 sudo[118211]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:03.579076 n-d-760454-3 sudo[118209]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:03.581885 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f56814e9-37a9-40c8-a0d4-e85211ceea3d tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1" returned: 0 in 0.967s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:03.583064 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f56814e9-37a9-40c8-a0d4-e85211ceea3d tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5808df2b-d327-4096-9625-6a494433f0f7 --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:03.641671 n-d-760454-3 sudo[118217]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5808df2b-d327-4096-9625-6a494433f0f7 --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g
Jan 25 13:17:03.642286 n-d-760454-3 sudo[118217]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:03.676767 n-d-760454-3 sudo[118211]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:03.679978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.780s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:03.681892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:03.726611 n-d-760454-3 sudo[118219]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:03.727205 n-d-760454-3 sudo[118219]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:04.724585 n-d-760454-3 sudo[118219]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:04.727211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.045s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:04.729125 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:04.735542 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Deleted volume successfully.
Jan 25 13:17:04.813623 n-d-760454-3 sudo[118217]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:04.815584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f56814e9-37a9-40c8-a0d4-e85211ceea3d tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5808df2b-d327-4096-9625-6a494433f0f7 --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g" returned: 0 in 1.233s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:04.885315 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7a810ac1-248e-4ef2-a036-99a56bf1fa35 tempest-VolumesTestJSON-690575906 None] Lock "b'cinder-690df0b3-d4dc-4b51-8dac-27356d85d21e-delete_volume'" released by "delete_volume" :: held 5.443s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:04.938824 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f56814e9-37a9-40c8-a0d4-e85211ceea3d tempest-VolumesDeleteCascade-1946341496 None] Create snapshot completed successfully
Jan 25 13:17:07.046711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f5748d89-9dc6-4597-8375-d4046cff25b0 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:07.115410 n-d-760454-3 sudo[118326]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:07.116129 n-d-760454-3 sudo[118326]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:07.312484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:07.317627 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:07.326131 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:07.357196 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (88ef139d-e29e-4b5e-b04b-47939a7e12d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:07.361601 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edee19b-58a4-4531-851d-ac6676f432dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:07.422352 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:07.475643 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3edee19b-58a4-4531-851d-ac6676f432dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1079613245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=e76d2400-6a95-4cdc-8c4c-3eb3e28143b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4049a4725648d6b957ba0c32d5259b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:07Z,user_id='a7de441897254a538de2fdab1ec90028',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:07.481819 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5db54b-2bbb-4144-85c8-f45df431918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:07.491963 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5db54b-2bbb-4144-85c8-f45df431918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:07.497526 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d937413b-aea7-4574-987a-49badaf18be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:07.510280 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d937413b-aea7-4574-987a-49badaf18be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76d2400-6a95-4cdc-8c4c-3eb3e28143b2', 'volume_name': 'volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:07.514631 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2503468a-f042-43ce-b7ff-10e455feb42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:07.520746 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2503468a-f042-43ce-b7ff-10e455feb42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:07.525527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80d45f0-3f31-4bf6-a0f0-fcc02f07c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:07.531254 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Volume e76d2400-6a95-4cdc-8c4c-3eb3e28143b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2', 'volume_size': 1}
Jan 25 13:17:07.533198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:07.597819 n-d-760454-3 sudo[118328]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:07.605057 n-d-760454-3 sudo[118328]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:08.678226 n-d-760454-3 sudo[118328]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:08.680574 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.147s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:08.685277 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80d45f0-3f31-4bf6-a0f0-fcc02f07c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:08.688727 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd942d1e-ace5-4285-bce0-a38e19d76a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:08.704952 n-d-760454-3 sudo[118326]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:08.708089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f5748d89-9dc6-4597-8375-d4046cff25b0 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1" returned: 0 in 1.662s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:08.712158 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f5748d89-9dc6-4597-8375-d4046cff25b0 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:08.752076 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Volume volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 (e76d2400-6a95-4cdc-8c4c-3eb3e28143b2): created successfully
Jan 25 13:17:08.755428 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd942d1e-ace5-4285-bce0-a38e19d76a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:08.759349 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (88ef139d-e29e-4b5e-b04b-47939a7e12d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:08.775279 n-d-760454-3 sudo[118361]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g
Jan 25 13:17:08.776920 n-d-760454-3 sudo[118361]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:08.824852 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-66dde193-b26b-4ab8-9487-d3e9a0763e94 tempest-VolumesListAdminTestJSON-58030689 None] Created volume successfully.
Jan 25 13:17:09.991037 n-d-760454-3 sudo[118361]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:09.993899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f5748d89-9dc6-4597-8375-d4046cff25b0 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a --snapshot stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 -L 1.00g" returned: 0 in 1.281s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:10.230462 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f5748d89-9dc6-4597-8375-d4046cff25b0 tempest-VolumesDeleteCascade-1946341496 None] Create snapshot completed successfully
Jan 25 13:17:11.293765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-2738a648-cb8b-43c3-846d-8d473f6ef6e1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:11.313173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:11.319349 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:11.321150 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:11.341875 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (3cd26d4a-60fc-4b99-b565-3c143131c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:11.348100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c93195-fb6b-4fa3-82b2-6d521c7c92f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:11.409328 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:11.479999 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c93195-fb6b-4fa3-82b2-6d521c7c92f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-600373068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=679a8702-5e2c-4e76-bda1-207b2d8ea669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4049a4725648d6b957ba0c32d5259b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:11Z,user_id='a7de441897254a538de2fdab1ec90028',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:11.484053 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d79efa-75a0-4b50-9b17-29dd7b4a2ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:11.486960 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d79efa-75a0-4b50-9b17-29dd7b4a2ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:11.490571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9835a32b-021c-4199-a942-62d0178e0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:11.493422 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9835a32b-021c-4199-a942-62d0178e0b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679a8702-5e2c-4e76-bda1-207b2d8ea669', 'volume_name': 'volume-679a8702-5e2c-4e76-bda1-207b2d8ea669', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:11.495910 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfad7ca-5294-4891-aba5-e09da822ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:11.498563 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfad7ca-5294-4891-aba5-e09da822ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:11.502609 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145e044a-8abe-4c93-ab55-c42bfe7c67b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:11.503497 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Volume 679a8702-5e2c-4e76-bda1-207b2d8ea669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679a8702-5e2c-4e76-bda1-207b2d8ea669', 'volume_size': 1}
Jan 25 13:17:11.504740 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:11.530615 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Skipping remove_export. No iscsi_target is presently exported for volume: 2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:11.531231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Performing cascade delete. {{(pid=89244) delete_volume /opt/stack/cinder/cinder/volume/manager.py:879}}
Jan 25 13:17:11.540652 n-d-760454-3 sudo[118481]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:11.541996 n-d-760454-3 sudo[118481]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:11.561665 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-52c3f695-5118-4f88-afa8-16c6f003a32a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:11.563946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:11.617284 n-d-760454-3 sudo[118483]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a
Jan 25 13:17:11.618461 n-d-760454-3 sudo[118483]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:12.315119 n-d-760454-3 sudo[118481]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:12.317437 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.812s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:12.322001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145e044a-8abe-4c93-ab55-c42bfe7c67b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679a8702-5e2c-4e76-bda1-207b2d8ea669', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:12.324424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4aece-1498-42bc-920a-a6d75470beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:12.387715 n-d-760454-3 sudo[118483]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:12.390345 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a" returned: 0 in 0.826s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:12.394816 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:12.413608 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Volume volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 (679a8702-5e2c-4e76-bda1-207b2d8ea669): created successfully
Jan 25 13:17:12.417061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4aece-1498-42bc-920a-a6d75470beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:12.425027 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (3cd26d4a-60fc-4b99-b565-3c143131c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:12.439845 n-d-760454-3 sudo[118516]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a
Jan 25 13:17:12.441137 n-d-760454-3 sudo[118516]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:12.474891 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5bb6ecc7-7ee5-466d-84ed-26662bd5f31d tempest-VolumesListAdminTestJSON-58030689 None] Created volume successfully.
Jan 25 13:17:13.713837 n-d-760454-3 sudo[118516]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:13.719460 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-52c3f695-5118-4f88-afa8-16c6f003a32a" returned: 0 in 1.325s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:14.035329 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['fb84fee4-902b-4cf0-b1ec-593559f74b0e', '31e7dcb7-63c8-4437-ad28-2b595d57641b', '046eecd4-c9d1-4cc8-8510-76be66c70f99', 'd16e1909-260c-4e80-8127-657a6aa274d7'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:14.037753 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:14.037753 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:14.037753 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:14.207102 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Delete snapshot completed successfully.
Jan 25 13:17:14.216729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-52c3f695-5118-4f88-afa8-16c6f003a32a-delete_snapshot'" released by "delete_snapshot" :: held 2.653s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:14.227378 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-5808df2b-d327-4096-9625-6a494433f0f7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:14.229417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:14.252409 n-d-760454-3 sudo[118587]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7
Jan 25 13:17:14.253019 n-d-760454-3 sudo[118587]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:15.008210 n-d-760454-3 sudo[118587]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:15.010906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7" returned: 0 in 0.781s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:15.013811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:15.102370 n-d-760454-3 sudo[118591]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7
Jan 25 13:17:15.105525 n-d-760454-3 sudo[118591]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:15.357256 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:15.365299 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:15.369064 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:15.391829 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (70abda08-bc67-4ca4-a597-f1ead10c2af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:15.397979 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f017a1f-175d-48fb-aed5-94638b1ede2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:15.437868 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:15.467197 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f017a1f-175d-48fb-aed5-94638b1ede2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-892331129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=3217a7cc-0a91-4576-af75-1936f49cc49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4049a4725648d6b957ba0c32d5259b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:15Z,user_id='a7de441897254a538de2fdab1ec90028',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:15.470729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9980a-aac8-463f-aebb-5da30d062ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:15.473413 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad9980a-aac8-463f-aebb-5da30d062ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:15.477693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325eae0b-41c3-443b-bc07-017d031553bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:15.480618 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325eae0b-41c3-443b-bc07-017d031553bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3217a7cc-0a91-4576-af75-1936f49cc49f', 'volume_name': 'volume-3217a7cc-0a91-4576-af75-1936f49cc49f', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:15.483124 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5274eda2-ae5c-4fed-bab5-3ab1ff704fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:15.486303 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5274eda2-ae5c-4fed-bab5-3ab1ff704fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:15.489450 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612f19d6-1a64-4224-a880-280739f96ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:15.489853 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Volume 3217a7cc-0a91-4576-af75-1936f49cc49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3217a7cc-0a91-4576-af75-1936f49cc49f', 'volume_size': 1}
Jan 25 13:17:15.491039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3217a7cc-0a91-4576-af75-1936f49cc49f stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:15.541052 n-d-760454-3 sudo[118593]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3217a7cc-0a91-4576-af75-1936f49cc49f stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:15.547949 n-d-760454-3 sudo[118593]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:16.011452 n-d-760454-3 sudo[118591]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:16.017281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5808df2b-d327-4096-9625-6a494433f0f7" returned: 0 in 1.003s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:16.235411 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['acdc0a26-065d-4f32-ad60-b6c347171b2c', '75ff2710-ebf1-4ae3-8286-ce6990a7c4ed', 'ee81d0be-52a0-4e8c-9d07-9301e20d8352', '20544059-cbc8-4652-a6e3-67cea798b6d7'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:16.238833 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:16.238833 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:16.238833 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:16.435085 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Delete snapshot completed successfully.
Jan 25 13:17:16.441320 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-5808df2b-d327-4096-9625-6a494433f0f7-delete_snapshot'" released by "delete_snapshot" :: held 2.214s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:16.442507 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Snapshots deleted, issuing volume delete {{(pid=89244) delete_volume /opt/stack/cinder/cinder/volume/manager.py:895}}
Jan 25 13:17:16.444181 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:16.470842 n-d-760454-3 sudo[118593]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:16.478242 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3217a7cc-0a91-4576-af75-1936f49cc49f stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.987s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:16.485049 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612f19d6-1a64-4224-a880-280739f96ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3217a7cc-0a91-4576-af75-1936f49cc49f', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:16.486167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a95d83-4c5a-4093-be13-6838c189b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:16.509840 n-d-760454-3 sudo[118664]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:16.510470 n-d-760454-3 sudo[118664]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:16.549283 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Volume volume-3217a7cc-0a91-4576-af75-1936f49cc49f (3217a7cc-0a91-4576-af75-1936f49cc49f): created successfully
Jan 25 13:17:16.552183 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a95d83-4c5a-4093-be13-6838c189b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:16.555801 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Flow 'volume_create_manager' (70abda08-bc67-4ca4-a597-f1ead10c2af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:16.589745 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1ce1282f-910c-4201-ba6d-0e93143035a7 tempest-VolumesListAdminTestJSON-58030689 None] Created volume successfully.
Jan 25 13:17:17.151748 n-d-760454-3 sudo[118664]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:17.154513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1" returned: 0 in 0.710s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:17.156325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:17.185168 n-d-760454-3 sudo[118668]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:17.185930 n-d-760454-3 sudo[118668]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:17.810390 n-d-760454-3 sudo[118668]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:17.815109 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1" returned: 0 in 0.658s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:17.820578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:17.882055 n-d-760454-3 sudo[118672]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:17.884002 n-d-760454-3 sudo[118672]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:18.760408 n-d-760454-3 sudo[118672]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:18.762867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2738a648-cb8b-43c3-846d-8d473f6ef6e1" returned: 0 in 0.943s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:18.764900 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Successfully deleted volume: 2738a648-cb8b-43c3-846d-8d473f6ef6e1
Jan 25 13:17:18.971935 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['89f98c26-e5e0-41ee-bd81-5e31b57d76d1', 'a030f52a-f8f9-4cbb-b8eb-3d3693804ba5', '5befd526-0029-4573-ad95-7d6ded3933bd', '39bf02aa-b843-4cbc-9e94-542f8ae4be60'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:18.975137 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:18.975137 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:18.975137 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:19.086088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:19.087712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:19.123441 n-d-760454-3 sudo[118681]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:19.124086 n-d-760454-3 sudo[118681]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:19.636070 n-d-760454-3 sudo[118681]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:19.638526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.551s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:19.641105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:19.698699 n-d-760454-3 sudo[118685]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:19.699837 n-d-760454-3 sudo[118685]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:19.820913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:19.826359 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:19.827442 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:19.862729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Flow 'volume_create_manager' (c47c51d4-aed5-4649-abdf-919b13a70fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:19.902367 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3d55c0-f594-41f3-8a91-52a102594db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:19.953082 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:19.987594 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3d55c0-f594-41f3-8a91-52a102594db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=46f31967-40c2-4fbf-af72-f98d10a7d71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9e89395704473f85e22b8c6616ecd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:20Z,user_id='c50472bb0d6141be8aa93b8b405f1847',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:19.991544 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71046236-e707-46b2-bd45-82d2ee3d2589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:19.994274 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71046236-e707-46b2-bd45-82d2ee3d2589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:19.997252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc8d44-2bde-48e7-9b5e-7cec67c44045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:20.000994 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc8d44-2bde-48e7-9b5e-7cec67c44045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f31967-40c2-4fbf-af72-f98d10a7d71d', 'volume_name': 'volume-46f31967-40c2-4fbf-af72-f98d10a7d71d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:20.004957 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ca2e94-08a5-483a-9221-fef6d0e31c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:20.008623 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ca2e94-08a5-483a-9221-fef6d0e31c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:20.011567 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eb8acd-826d-4702-874b-82b9994ea3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:20.015845 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Volume 46f31967-40c2-4fbf-af72-f98d10a7d71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f31967-40c2-4fbf-af72-f98d10a7d71d', 'volume_size': 1}
Jan 25 13:17:20.015845 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46f31967-40c2-4fbf-af72-f98d10a7d71d stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:20.062439 n-d-760454-3 sudo[118687]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46f31967-40c2-4fbf-af72-f98d10a7d71d stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:20.062988 n-d-760454-3 sudo[118687]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:20.577894 n-d-760454-3 sudo[118685]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:20.580859 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.939s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:20.582888 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:20.597293 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Deleted volume successfully.
Jan 25 13:17:20.663122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-e19a1943-06b2-4c12-ae70-1713bd6056f5 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-2738a648-cb8b-43c3-846d-8d473f6ef6e1-delete_volume'" released by "delete_volume" :: held 9.365s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:20.826533 n-d-760454-3 sudo[118687]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:20.828939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46f31967-40c2-4fbf-af72-f98d10a7d71d stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.815s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:20.832129 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97eb8acd-826d-4702-874b-82b9994ea3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f31967-40c2-4fbf-af72-f98d10a7d71d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:20.835177 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958de03b-eb61-46e4-bc1b-b72c5695e75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:20.875877 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Volume volume-46f31967-40c2-4fbf-af72-f98d10a7d71d (46f31967-40c2-4fbf-af72-f98d10a7d71d): created successfully
Jan 25 13:17:20.878278 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958de03b-eb61-46e4-bc1b-b72c5695e75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:20.882162 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Flow 'volume_create_manager' (c47c51d4-aed5-4649-abdf-919b13a70fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:20.939219 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-33a25380-989e-4b77-8c8b-1f0e0a2828e9 tempest-VolumesListAdminTestJSON-267108995 None] Created volume successfully.
Jan 25 13:17:22.242882 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:22.242882 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:22.242882 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:22.303946 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (0b957257-3c05-4664-8301-33d85175c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:22.322998 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a8babc-b93d-4fc0-af79-26255dd78f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:22.415122 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:22.489913 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a8babc-b93d-4fc0-af79-26255dd78f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-209571672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=193d7129-ba23-41b4-8426-b3157d3b7252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74560616a00e405986ff2d9fb162d4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:21Z,user_id='892cfa816bb14aa08ef5cb99b580efa5',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:22.499765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986cabde-c141-420b-98fe-f72eb933ab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:22.504517 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986cabde-c141-420b-98fe-f72eb933ab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:22.514506 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a534b9-5baf-47a3-8da5-d8d85ecf3880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:22.518738 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a534b9-5baf-47a3-8da5-d8d85ecf3880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193d7129-ba23-41b4-8426-b3157d3b7252', 'volume_name': 'volume-193d7129-ba23-41b4-8426-b3157d3b7252', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:22.527597 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f3d0b8-a658-4d71-b774-8ba415c51173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:22.533855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f3d0b8-a658-4d71-b774-8ba415c51173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:22.540352 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1172ed75-38e8-479a-8d8e-db58293422ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:22.548871 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Volume 193d7129-ba23-41b4-8426-b3157d3b7252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193d7129-ba23-41b4-8426-b3157d3b7252', 'volume_size': 1}
Jan 25 13:17:22.548871 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-193d7129-ba23-41b4-8426-b3157d3b7252 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:22.562346 n-d-760454-3 sudo[118732]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-193d7129-ba23-41b4-8426-b3157d3b7252 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:22.562897 n-d-760454-3 sudo[118732]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:22.678810 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Lock "b'cinder-46f31967-40c2-4fbf-af72-f98d10a7d71d-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:22.817401 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Skipping remove_export. No iscsi_target is presently exported for volume: 46f31967-40c2-4fbf-af72-f98d10a7d71d
Jan 25 13:17:22.818672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:22.873480 n-d-760454-3 sudo[118734]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d
Jan 25 13:17:22.875255 n-d-760454-3 sudo[118734]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:22.961621 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-3217a7cc-0a91-4576-af75-1936f49cc49f-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:23.206344 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Skipping remove_export. No iscsi_target is presently exported for volume: 3217a7cc-0a91-4576-af75-1936f49cc49f
Jan 25 13:17:23.207963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:23.246320 n-d-760454-3 sudo[118750]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f
Jan 25 13:17:23.256077 n-d-760454-3 sudo[118750]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:23.418004 n-d-760454-3 sudo[118732]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:23.421448 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-193d7129-ba23-41b4-8426-b3157d3b7252 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.876s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:23.427484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1172ed75-38e8-479a-8d8e-db58293422ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193d7129-ba23-41b4-8426-b3157d3b7252', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:23.430283 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f3a29f-14cd-4cbe-8501-fa1531be723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:23.480874 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Volume volume-193d7129-ba23-41b4-8426-b3157d3b7252 (193d7129-ba23-41b4-8426-b3157d3b7252): created successfully
Jan 25 13:17:23.483939 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f3a29f-14cd-4cbe-8501-fa1531be723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:23.489063 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (0b957257-3c05-4664-8301-33d85175c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:23.527235 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6a6944cb-39e7-4770-8474-2203c2e7c0ea tempest-VolumesDeleteCascade-1946341496 None] Created volume successfully.
Jan 25 13:17:24.105814 n-d-760454-3 sudo[118734]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:24.109109 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d" returned: 0 in 1.290s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:24.110160 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:24.153235 n-d-760454-3 sudo[118771]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d
Jan 25 13:17:24.156094 n-d-760454-3 sudo[118771]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:24.356105 n-d-760454-3 sudo[118750]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:24.360254 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f" returned: 0 in 1.150s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:24.361549 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:24.404018 n-d-760454-3 sudo[118775]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f
Jan 25 13:17:24.409271 n-d-760454-3 sudo[118775]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:24.990119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5505cfbb-3883-47fb-89c1-cdb4d49ddd9d tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:25.058114 n-d-760454-3 sudo[118779]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:25.058753 n-d-760454-3 sudo[118779]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:25.197862 n-d-760454-3 sudo[118771]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:25.200885 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d" returned: 0 in 1.090s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:25.202921 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:25.253973 n-d-760454-3 sudo[118783]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d
Jan 25 13:17:25.254603 n-d-760454-3 sudo[118783]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:25.294794 n-d-760454-3 sudo[118775]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:25.298010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f" returned: 0 in 0.936s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:25.299871 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:25.341157 n-d-760454-3 sudo[118785]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f
Jan 25 13:17:25.349431 n-d-760454-3 sudo[118785]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:26.370271 n-d-760454-3 sudo[118779]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:26.372622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5505cfbb-3883-47fb-89c1-cdb4d49ddd9d tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252" returned: 0 in 1.382s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:26.374648 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5505cfbb-3883-47fb-89c1-cdb4d49ddd9d tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 --snapshot stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:26.423736 n-d-760454-3 sudo[118796]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 --snapshot stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 -L 1.00g
Jan 25 13:17:26.425101 n-d-760454-3 sudo[118796]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:26.482462 n-d-760454-3 sudo[118783]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:26.485825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46f31967-40c2-4fbf-af72-f98d10a7d71d" returned: 0 in 1.282s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:26.487289 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Successfully deleted volume: 46f31967-40c2-4fbf-af72-f98d10a7d71d
Jan 25 13:17:26.619038 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Created reservations ['25c382a1-cce2-4f37-a129-f9b17bab7375', '9becfd61-f849-4e50-965e-f3bdfc92434a', '38301d8d-85ba-42f2-aa37-cad803c05a45', 'dbbc3477-229b-4705-a9e9-3d52baa0e570'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:26.622573 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:26.622573 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:26.622573 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:26.657152 n-d-760454-3 sudo[118785]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:26.659361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3217a7cc-0a91-4576-af75-1936f49cc49f" returned: 0 in 1.360s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:26.660308 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Successfully deleted volume: 3217a7cc-0a91-4576-af75-1936f49cc49f
Jan 25 13:17:26.863570 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:26.864383 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:26.912294 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Created reservations ['b3006b49-2ead-4623-badf-eee80ebbecac', 'fe6b58d5-d9b1-4eda-8ae6-61dd01003de6', '22eb7395-9e64-4d74-8c5c-5071b42a780a', '0fcb0029-6dda-468b-8812-214bfbff5873'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:26.916513 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:26.916513 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:26.916513 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:26.922726 n-d-760454-3 sudo[118805]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:26.923259 n-d-760454-3 sudo[118805]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:27.066617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:27.069146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:27.137352 n-d-760454-3 sudo[118809]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:27.137974 n-d-760454-3 sudo[118809]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:27.625044 n-d-760454-3 sudo[118796]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:27.627932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5505cfbb-3883-47fb-89c1-cdb4d49ddd9d tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 --snapshot stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 -L 1.00g" returned: 0 in 1.253s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:27.812315 n-d-760454-3 sudo[118805]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:27.812819 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5505cfbb-3883-47fb-89c1-cdb4d49ddd9d tempest-VolumesDeleteCascade-1946341496 None] Create snapshot completed successfully
Jan 25 13:17:27.818213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.954s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:27.820175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:27.851114 n-d-760454-3 sudo[118910]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:27.851830 n-d-760454-3 sudo[118910]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:27.902433 n-d-760454-3 sudo[118809]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:27.905474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:27.907057 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:27.949595 n-d-760454-3 sudo[118912]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:27.951126 n-d-760454-3 sudo[118912]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:28.336382 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-679a8702-5e2c-4e76-bda1-207b2d8ea669-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:28.633627 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Skipping remove_export. No iscsi_target is presently exported for volume: 679a8702-5e2c-4e76-bda1-207b2d8ea669
Jan 25 13:17:28.633627 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:28.669152 n-d-760454-3 sudo[118914]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669
Jan 25 13:17:28.669767 n-d-760454-3 sudo[118914]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:29.324141 n-d-760454-3 sudo[118910]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:29.327297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:29.329524 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:29.347052 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Deleted volume successfully.
Jan 25 13:17:29.422514 n-d-760454-3 sudo[118912]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:29.438406 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.523s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:29.438406 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ef4ccfbe-f289-4d89-a597-cd84ce893e8e tempest-VolumesListAdminTestJSON-267108995 None] Lock "b'cinder-46f31967-40c2-4fbf-af72-f98d10a7d71d-delete_volume'" released by "delete_volume" :: held 6.753s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:29.438406 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:29.453364 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Deleted volume successfully.
Jan 25 13:17:29.529123 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-40276075-93fa-455a-aeff-4a7e859eac60 tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-3217a7cc-0a91-4576-af75-1936f49cc49f-delete_volume'" released by "delete_volume" :: held 6.568s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:29.739746 n-d-760454-3 sudo[118914]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:29.741888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669" returned: 0 in 1.129s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:29.743035 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:29.792918 n-d-760454-3 sudo[118922]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669
Jan 25 13:17:29.793527 n-d-760454-3 sudo[118922]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:30.254262 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:30.259331 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:30.259897 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:30.329704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (ccf469cc-27a9-4c2e-8423-4c351ab742d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:30.337267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903a2fcb-ad0c-4110-b219-69ddc6037e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:30.386614 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:30.439583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903a2fcb-ad0c-4110-b219-69ddc6037e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-568448760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=bf658c0b-0177-4960-a8ed-451bfcd1f7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74560616a00e405986ff2d9fb162d4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79a56de3-06a7-45b0-9bcf-721a55d403a6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:30Z,user_id='892cfa816bb14aa08ef5cb99b580efa5',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:30.445757 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7a3e29-b994-456a-ae09-a5a62c9f4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:30.451228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7a3e29-b994-456a-ae09-a5a62c9f4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:30.459414 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69f091-ce3f-4642-9b6e-b2516ea5765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:30.473231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69f091-ce3f-4642-9b6e-b2516ea5765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf658c0b-0177-4960-a8ed-451bfcd1f7d4', 'volume_name': 'volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4', 'volume_size': 1, 'snapshot_id': '79a56de3-06a7-45b0-9bcf-721a55d403a6'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:30.476803 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a415a546-dba2-4603-a3d8-f5549a3f6403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:30.480386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a415a546-dba2-4603-a3d8-f5549a3f6403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:30.490084 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39e699d-6484-406e-8d50-dbfebc943628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:30.491220 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Volume bf658c0b-0177-4960-a8ed-451bfcd1f7d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4', 'volume_size': 1, 'snapshot_id': '79a56de3-06a7-45b0-9bcf-721a55d403a6'}
Jan 25 13:17:30.536318 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:30.591169 n-d-760454-3 sudo[118924]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:30.591736 n-d-760454-3 sudo[118924]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:30.690938 n-d-760454-3 sudo[118922]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:30.693307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669" returned: 0 in 0.950s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:30.696172 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:30.716311 n-d-760454-3 sudo[118928]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669
Jan 25 13:17:30.717970 n-d-760454-3 sudo[118928]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:31.558680 n-d-760454-3 sudo[118928]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:31.588389 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-679a8702-5e2c-4e76-bda1-207b2d8ea669" returned: 0 in 0.865s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:31.588389 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Successfully deleted volume: 679a8702-5e2c-4e76-bda1-207b2d8ea669
Jan 25 13:17:31.678372 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Created reservations ['c3a8a192-ffda-49f4-9833-0dc483eb5da2', 'c10189b3-bc13-4e32-ada4-6fbb6eca204d', 'e64a4c68-0e3f-4e3d-93bb-214f8568ac11', '49aab5ca-d6ad-46c9-88f5-834408531f79'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:31.681454 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:31.681454 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:31.681454 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:31.921343 n-d-760454-3 sudo[118924]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:31.923334 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.387s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:31.924889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:31.953642 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:31.955049 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:31.967664 n-d-760454-3 sudo[118966]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
Jan 25 13:17:31.968799 n-d-760454-3 sudo[118966]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:31.976117 n-d-760454-3 sudo[118967]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:31.977386 n-d-760454-3 sudo[118967]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:32.620368 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:32.830780 n-d-760454-3 sudo[118967]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:32.895430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.940s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:32.910086 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:32.952181 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Skipping remove_export. No iscsi_target is presently exported for volume: e76d2400-6a95-4cdc-8c4c-3eb3e28143b2
Jan 25 13:17:32.953497 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:32.954977 n-d-760454-3 sudo[118975]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:32.964311 n-d-760454-3 sudo[118975]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:32.974038 n-d-760454-3 sudo[118966]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:32.992644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version" returned: 0 in 1.067s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:32.994439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:33.025343 n-d-760454-3 sudo[118976]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2
Jan 25 13:17:33.029295 n-d-760454-3 sudo[118976]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:33.055385 n-d-760454-3 sudo[118978]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6
Jan 25 13:17:33.058375 n-d-760454-3 sudo[118978]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:34.274395 n-d-760454-3 sudo[118978]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:34.291098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6" returned: 0 in 1.282s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:34.293828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:34.403883 n-d-760454-3 sudo[118989]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 iflag=direct
Jan 25 13:17:34.406127 n-d-760454-3 sudo[118989]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:35.216272 n-d-760454-3 sudo[118989]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:35.218815 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 iflag=direct" returned: 0 in 0.925s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:35.219959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:35.261204 n-d-760454-3 sudo[118995]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 oflag=direct
Jan 25 13:17:35.267993 n-d-760454-3 sudo[118995]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:35.855185 n-d-760454-3 sudo[118995]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:35.858111 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 oflag=direct" returned: 0 in 0.638s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:35.859914 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:35.912142 n-d-760454-3 sudo[119004]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:17:35.930515 n-d-760454-3 sudo[119004]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:35.948088 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:17:35.949180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:35.950334 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:36.008919 n-d-760454-3 sudo[119011]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:36.010589 n-d-760454-3 sudo[119011]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:36.071251 n-d-760454-3 sudo[118975]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:36.074211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.164s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:36.077278 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:36.090748 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Deleted volume successfully.
Jan 25 13:17:36.142498 n-d-760454-3 sudo[118976]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:36.144937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2" returned: 0 in 3.191s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:36.146467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:36.200724 n-d-760454-3 sudo[119013]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2
Jan 25 13:17:36.202194 n-d-760454-3 sudo[119013]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:36.933769 n-d-760454-3 sudo[119011]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:36.937134 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.986s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:36.938948 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:36.989703 n-d-760454-3 sudo[119018]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:36.990849 n-d-760454-3 sudo[119018]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:37.033181 n-d-760454-3 sudo[119013]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:37.036268 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2" returned: 0 in 0.889s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:37.038791 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:37.057930 n-d-760454-3 sudo[119022]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2
Jan 25 13:17:37.059028 n-d-760454-3 sudo[119022]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:38.989625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-be4b6f81-6187-4439-8324-2a07071eafea tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-679a8702-5e2c-4e76-bda1-207b2d8ea669-delete_volume'" released by "delete_volume" :: held 10.648s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:39.177657 n-d-760454-3 sudo[119018]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:39.179429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.241s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:39.180999 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:39.202078 n-d-760454-3 sudo[119022]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:39.205721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2" returned: 0 in 2.166s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:39.207019 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Successfully deleted volume: e76d2400-6a95-4cdc-8c4c-3eb3e28143b2
Jan 25 13:17:39.611781 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Created reservations ['ec2b8b82-e144-471f-a733-04944dcbba5d', '5615b667-9962-40e1-b1f7-574689607b3a', '76965a72-e1e3-4fe9-99f0-d8d3ac58af31', '583ff8fa-f9af-4916-a59e-d413bac66a58'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:39.614499 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:39.614499 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:39.614499 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:39.837062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-92d5e860-d2bc-4284-9277-28ae7509aeaf tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51'" acquired by "attach_volume" :: waited 0.023s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:39.934106 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:39.935359 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:39.958810 n-d-760454-3 sudo[119033]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:39.959569 n-d-760454-3 sudo[119033]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:40.220471 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-92d5e860-d2bc-4284-9277-28ae7509aeaf tempest-VolumesActionsTest-540514637 None] Attaching volume f78fad85-32b3-4c14-9de1-1781f62f2b51 to instance 09eaac67-ed4c-4e8a-b858-323bc51ed931 at mountpoint /dev/sdb on host None.
Jan 25 13:17:40.436455 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-92d5e860-d2bc-4284-9277-28ae7509aeaf tempest-VolumesActionsTest-540514637 None] Attach volume completed successfully.
Jan 25 13:17:40.452102 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-92d5e860-d2bc-4284-9277-28ae7509aeaf tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51'" released by "attach_volume" :: held 0.615s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:40.489315 n-d-760454-3 sudo[119033]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:40.491317 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:40.493044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:40.522392 n-d-760454-3 sudo[119037]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:40.523407 n-d-760454-3 sudo[119037]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:41.205160 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:41.240510 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] Detaching volume f78fad85-32b3-4c14-9de1-1781f62f2b51 from instance 09eaac67-ed4c-4e8a-b858-323bc51ed931.
Jan 25 13:17:41.253605 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] Skipping remove_export. No iscsi_target is presently exported for volume: f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:17:41.594420 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:41.594420 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:41.594420 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:41.718596 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] Detach volume completed successfully.
Jan 25 13:17:41.733671 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-baa9d2f0-8195-47e3-83a0-e2babcd06203 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-detach_volume'" released by "detach_volume" :: held 0.529s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:41.779496 n-d-760454-3 sudo[119037]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:41.781888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.289s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:41.783886 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:41.791584 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Deleted volume successfully.
Jan 25 13:17:41.910475 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33fc14c5-0e5f-41cb-b2ea-078fa6bb57c0 tempest-VolumesListAdminTestJSON-58030689 None] Lock "b'cinder-e76d2400-6a95-4cdc-8c4c-3eb3e28143b2-delete_volume'" released by "delete_volume" :: held 9.292s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:45.088915 n-d-760454-3 sudo[119004]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:45.098794 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 9.238s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:45.100575 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--79a56de3--06a7--45b0--9bcf--721a55d403a6, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--bf658c0b--0177--4960--a8ed--451bfcd1f7d4, size 1024.00 MB, duration 9.24 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:17:45.101505 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Volume copy 1024.00 MB at 110.81 MB/s
Jan 25 13:17:45.224181 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39e699d-6484-406e-8d50-dbfebc943628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4', 'volume_size': 1, 'snapshot_id': '79a56de3-06a7-45b0-9bcf-721a55d403a6'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:45.239481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b929a1-23fc-40f8-86c9-4482b01bcd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:45.274779 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Volume volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 (bf658c0b-0177-4960-a8ed-451bfcd1f7d4): created successfully
Jan 25 13:17:45.278006 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b929a1-23fc-40f8-86c9-4482b01bcd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:45.282138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Flow 'volume_create_manager' (ccf469cc-27a9-4c2e-8423-4c351ab742d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:45.331901 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b147508c-7101-4c3d-a0ec-7529492fddfe tempest-VolumesDeleteCascade-1946341496 None] Created volume successfully.
Jan 25 13:17:46.622878 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-193d7129-ba23-41b4-8426-b3157d3b7252-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:46.826147 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Skipping remove_export. No iscsi_target is presently exported for volume: 193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:46.826551 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Performing cascade delete. {{(pid=89244) delete_volume /opt/stack/cinder/cinder/volume/manager.py:879}}
Jan 25 13:17:46.863446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-79a56de3-06a7-45b0-9bcf-721a55d403a6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:46.865798 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:46.914014 n-d-760454-3 sudo[119051]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6
Jan 25 13:17:46.915103 n-d-760454-3 sudo[119051]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:47.625673 n-d-760454-3 sudo[119051]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:47.629727 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6" returned: 0 in 0.762s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:47.632112 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:47.682075 n-d-760454-3 sudo[119055]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6
Jan 25 13:17:47.685677 n-d-760454-3 sudo[119055]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:49.004024 n-d-760454-3 sudo[119055]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:49.007545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-79a56de3-06a7-45b0-9bcf-721a55d403a6" returned: 0 in 1.375s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:49.276751 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['31a30f21-8679-4971-a4e1-1feff68b3a1d', '28e108da-a67a-402e-83b6-89cad6d916b5', 'f00a895a-8d45-406d-8196-f71495277442', '4a40c8bc-83cc-4186-ac77-26c462c09c7d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:49.282004 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:49.282004 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:49.282004 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:49.411603 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Delete snapshot completed successfully.
Jan 25 13:17:49.421250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-79a56de3-06a7-45b0-9bcf-721a55d403a6-delete_snapshot'" released by "delete_snapshot" :: held 2.558s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:49.422002 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Snapshots deleted, issuing volume delete {{(pid=89244) delete_volume /opt/stack/cinder/cinder/volume/manager.py:895}}
Jan 25 13:17:49.423467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:49.443767 n-d-760454-3 sudo[119096]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:49.444957 n-d-760454-3 sudo[119096]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:50.082928 n-d-760454-3 sudo[119096]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:50.085461 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252" returned: 0 in 0.662s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:50.087030 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:50.145569 n-d-760454-3 sudo[119102]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:50.149612 n-d-760454-3 sudo[119102]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:50.951743 n-d-760454-3 sudo[119102]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:50.954572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252" returned: 0 in 0.867s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:50.962148 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:51.011990 n-d-760454-3 sudo[119106]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:51.013662 n-d-760454-3 sudo[119106]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:52.035953 n-d-760454-3 sudo[119106]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:52.039054 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-193d7129-ba23-41b4-8426-b3157d3b7252" returned: 0 in 1.081s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:52.041092 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Successfully deleted volume: 193d7129-ba23-41b4-8426-b3157d3b7252
Jan 25 13:17:52.154696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['259b6697-329a-4da6-9da3-d2a36ec05e95', '18beac79-ee6f-430c-b59b-718233fbda15', 'b38a76b2-c053-42b0-ae73-b718383df0c4', 'd2c15701-76e5-4b97-83e0-015746a95b00'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:52.157692 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:52.157692 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:52.157692 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:52.343797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:52.344794 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:52.407065 n-d-760454-3 sudo[119115]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:52.424926 n-d-760454-3 sudo[119115]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:52.683685 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:17:52.690337 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:17:52.695527 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:17:52.739993 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Flow 'volume_create_manager' (a65ac963-62eb-4f3a-877a-0ae135effffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:52.750854 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9298202a-670c-460c-8a45-5ace7fdef559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:52.808098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:17:52.880793 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9298202a-670c-460c-8a45-5ace7fdef559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1803816933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=165afc66-52b8-4e7f-ab80-c2da76e98308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b97fa2ced1490890b8e7dd8caededd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:17:52Z,user_id='0bcfc28dcf014eb99c090a6178f3dd06',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:52.884924 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd990d3-da73-4010-a492-b4881fe47015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:52.891643 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd990d3-da73-4010-a492-b4881fe47015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:52.905550 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76d35fe-39f7-4da3-b7b9-567105a7f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:52.909847 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76d35fe-39f7-4da3-b7b9-567105a7f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165afc66-52b8-4e7f-ab80-c2da76e98308', 'volume_name': 'volume-165afc66-52b8-4e7f-ab80-c2da76e98308', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:52.915266 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e23f1f-93df-4499-bb3a-75de80b834eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:52.923286 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e23f1f-93df-4499-bb3a-75de80b834eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:52.934387 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b51c94-bedd-416c-8c65-bd8c39bc0624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:52.948909 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Volume 165afc66-52b8-4e7f-ab80-c2da76e98308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165afc66-52b8-4e7f-ab80-c2da76e98308', 'volume_size': 1}
Jan 25 13:17:52.948909 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-165afc66-52b8-4e7f-ab80-c2da76e98308 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:53.000245 n-d-760454-3 sudo[119117]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-165afc66-52b8-4e7f-ab80-c2da76e98308 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:17:53.001230 n-d-760454-3 sudo[119117]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:53.416971 n-d-760454-3 sudo[119115]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:53.425265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.074s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:53.425265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:53.459247 n-d-760454-3 sudo[119121]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:53.460607 n-d-760454-3 sudo[119121]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:53.735085 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-bf658c0b-0177-4960-a8ed-451bfcd1f7d4-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:54.225747 n-d-760454-3 sudo[119117]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:54.315067 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-165afc66-52b8-4e7f-ab80-c2da76e98308 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.378s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:54.317753 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b51c94-bedd-416c-8c65-bd8c39bc0624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165afc66-52b8-4e7f-ab80-c2da76e98308', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:54.320237 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb626ea0-cb2b-43b2-88dd-777576264cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:17:54.353904 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Skipping remove_export. No iscsi_target is presently exported for volume: bf658c0b-0177-4960-a8ed-451bfcd1f7d4
Jan 25 13:17:54.355110 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:54.390693 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Volume volume-165afc66-52b8-4e7f-ab80-c2da76e98308 (165afc66-52b8-4e7f-ab80-c2da76e98308): created successfully
Jan 25 13:17:54.396324 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb626ea0-cb2b-43b2-88dd-777576264cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:17:54.401906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Flow 'volume_create_manager' (a65ac963-62eb-4f3a-877a-0ae135effffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:17:54.417592 n-d-760454-3 sudo[119156]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4
Jan 25 13:17:54.418680 n-d-760454-3 sudo[119156]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:54.451607 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4d444e0a-0e84-4a40-87c7-9e31553a6e5c tempest-AbsoluteLimitsTests-1319405531 None] Created volume successfully.
Jan 25 13:17:54.583958 n-d-760454-3 sudo[119121]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:54.585912 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.164s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:54.587868 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:54.594274 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Deleted volume successfully.
Jan 25 13:17:54.640961 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-33eaf3ba-f162-476b-ab66-9b716c6182dc tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-193d7129-ba23-41b4-8426-b3157d3b7252-delete_volume'" released by "delete_volume" :: held 8.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:17:54.806193 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] 26410685-d31f-4958-b202-1bf9180c44dd was raw, no need to convert to raw {{(pid=89244) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:748}}
Jan 25 13:17:54.807521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1000 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:54.828854 n-d-760454-3 sudo[119159]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1000 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51
Jan 25 13:17:54.829436 n-d-760454-3 sudo[119159]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:55.024447 n-d-760454-3 sudo[119156]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:55.026925 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4" returned: 0 in 0.671s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:55.029291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:55.048599 n-d-760454-3 sudo[119162]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4
Jan 25 13:17:55.049656 n-d-760454-3 sudo[119162]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:55.284809 n-d-760454-3 sudo[119159]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:55.287104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1000 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51" returned: 0 in 0.479s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:55.620379 n-d-760454-3 sudo[119162]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:55.625970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4" returned: 0 in 0.595s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:55.629642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:55.694073 n-d-760454-3 sudo[119167]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4
Jan 25 13:17:55.701077 n-d-760454-3 sudo[119167]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:56.000783 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Lock "b'cinder-165afc66-52b8-4e7f-ab80-c2da76e98308-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:17:56.324470 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Skipping remove_export. No iscsi_target is presently exported for volume: 165afc66-52b8-4e7f-ab80-c2da76e98308
Jan 25 13:17:56.326214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:56.392907 n-d-760454-3 sudo[119169]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308
Jan 25 13:17:56.396404 n-d-760454-3 sudo[119169]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:56.955081 n-d-760454-3 sudo[119167]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:56.957393 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-bf658c0b-0177-4960-a8ed-451bfcd1f7d4" returned: 0 in 1.328s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:56.959726 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Successfully deleted volume: bf658c0b-0177-4960-a8ed-451bfcd1f7d4
Jan 25 13:17:57.143667 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Created reservations ['d03d7862-b054-4174-ad15-81119ff4ddf8', '21ad4476-da57-44d7-8836-45f020e4608a', '0c3abc3a-9fc0-427e-a159-47d209c90716', '669c4d4d-b1cf-4a38-a116-a6879d645768'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:17:57.146592 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:17:57.146592 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:17:57.146592 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:17:57.358937 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:17:57.360205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:57.466343 n-d-760454-3 sudo[119180]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:17:57.471417 n-d-760454-3 sudo[119180]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:57.479270 n-d-760454-3 sudo[119169]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:57.484308 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308" returned: 0 in 1.157s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:57.496125 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:57.556183 n-d-760454-3 sudo[119182]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308
Jan 25 13:17:57.561929 n-d-760454-3 sudo[119182]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:58.254055 n-d-760454-3 sudo[119180]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:58.258718 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:58.268683 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:58.398599 n-d-760454-3 sudo[119186]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:17:58.399194 n-d-760454-3 sudo[119186]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:59.082993 n-d-760454-3 sudo[119182]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:59.095081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308" returned: 0 in 1.590s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:59.115878 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:17:59.219090 n-d-760454-3 sudo[119190]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308
Jan 25 13:17:59.230532 n-d-760454-3 sudo[119190]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:17:59.610696 n-d-760454-3 sudo[119186]: pam_unix(sudo:session): session closed for user root
Jan 25 13:17:59.617320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.350s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:17:59.620470 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:17:59.678196 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Deleted volume successfully.
Jan 25 13:17:59.791661 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-01ead0fd-0154-4068-9335-06936e4834e3 tempest-VolumesDeleteCascade-1946341496 None] Lock "b'cinder-bf658c0b-0177-4960-a8ed-451bfcd1f7d4-delete_volume'" released by "delete_volume" :: held 6.056s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:18:00.392523 n-d-760454-3 sudo[119190]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:00.394670 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-165afc66-52b8-4e7f-ab80-c2da76e98308" returned: 0 in 1.284s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:00.395862 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Successfully deleted volume: 165afc66-52b8-4e7f-ab80-c2da76e98308
Jan 25 13:18:00.519640 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Created reservations ['6c7b0898-ef3e-4ab1-9d7b-80463cf1f046', '5258358f-fd16-4c6f-85b1-15ff9b235eb7', 'f5ce056d-2541-453b-ac14-d79f9311168e', '6f40b2c9-cfb4-4c86-9a65-a3be359b1464'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:18:00.522287 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:18:00.522287 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:18:00.522287 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:18:00.681874 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:18:00.683220 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:00.737831 n-d-760454-3 sudo[119201]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:18:00.738463 n-d-760454-3 sudo[119201]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:01.373422 n-d-760454-3 sudo[119201]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:01.375841 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:01.377606 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:01.434688 n-d-760454-3 sudo[119205]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:18:01.435242 n-d-760454-3 sudo[119205]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:02.333353 n-d-760454-3 sudo[119205]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:02.337422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.958s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:02.342940 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:18:02.358891 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Deleted volume successfully.
Jan 25 13:18:02.439246 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-bd400f11-74d4-47cd-b010-43ef62118d43 tempest-AbsoluteLimitsTests-1319405531 None] Lock "b'cinder-165afc66-52b8-4e7f-ab80-c2da76e98308-delete_volume'" released by "delete_volume" :: held 6.436s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:18:29.803550 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Lock "b'cinder-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:18:29.953828 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Skipping remove_export. No iscsi_target is presently exported for volume: a0e4d92f-b693-4a09-abae-c6fbbc2c9b82
Jan 25 13:18:29.954875 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:30.001181 n-d-760454-3 sudo[119316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82
Jan 25 13:18:30.001773 n-d-760454-3 sudo[119316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:30.676846 n-d-760454-3 sudo[119316]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:30.680389 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82" returned: 0 in 0.725s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:30.681939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:30.716237 n-d-760454-3 sudo[119322]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82
Jan 25 13:18:30.721269 n-d-760454-3 sudo[119322]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:31.543420 n-d-760454-3 sudo[119322]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:31.546372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82" returned: 0 in 0.864s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:31.548162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:31.588615 n-d-760454-3 sudo[119326]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82
Jan 25 13:18:31.594276 n-d-760454-3 sudo[119326]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:32.460132 n-d-760454-3 sudo[119326]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:32.462742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82" returned: 0 in 0.914s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:32.464920 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Successfully deleted volume: a0e4d92f-b693-4a09-abae-c6fbbc2c9b82
Jan 25 13:18:32.611140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Created reservations ['55f33183-1291-485f-86c7-0c53e04c8470', '6be8068f-5dd0-4b11-9264-d8a9ecf45a82', '1ca3070a-98d8-47df-815f-f2f05f04bbb8', 'e0b82018-e636-46fe-aae4-80235c29fb9a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:18:32.614520 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:18:32.614520 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:18:32.614520 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:18:32.732151 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:18:32.734100 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:32.791561 n-d-760454-3 sudo[119335]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:18:32.796115 n-d-760454-3 sudo[119335]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:33.388481 n-d-760454-3 sudo[119335]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:33.391758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:33.395252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:33.431563 n-d-760454-3 sudo[119339]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:18:33.432662 n-d-760454-3 sudo[119339]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:34.155975 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Lock "b'cinder-8d099c9c-6aef-468d-ae15-f076157ec114-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:18:34.336356 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Skipping remove_export. No iscsi_target is presently exported for volume: 8d099c9c-6aef-468d-ae15-f076157ec114
Jan 25 13:18:34.337518 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:34.383058 n-d-760454-3 sudo[119346]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114
Jan 25 13:18:34.383660 n-d-760454-3 sudo[119346]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:34.496714 n-d-760454-3 sudo[119339]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:34.500102 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.104s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:34.502235 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:18:34.514220 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Deleted volume successfully.
Jan 25 13:18:34.572345 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a5db3830-9839-4212-900b-54aa4fe92b32 tempest-ServersNegativeTestJSON-380865974 None] Lock "b'cinder-a0e4d92f-b693-4a09-abae-c6fbbc2c9b82-delete_volume'" released by "delete_volume" :: held 4.769s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:18:35.662539 n-d-760454-3 sudo[119346]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:35.664396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114" returned: 0 in 1.327s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:35.665463 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:35.700791 n-d-760454-3 sudo[119350]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114
Jan 25 13:18:35.702068 n-d-760454-3 sudo[119350]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:35.950386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:18:35.950857 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:18:35.951729 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:36.008432 n-d-760454-3 sudo[119352]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:18:36.009787 n-d-760454-3 sudo[119352]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:36.746830 n-d-760454-3 sudo[119350]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:36.757681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114" returned: 0 in 1.092s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:36.769247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:36.861099 n-d-760454-3 sudo[119356]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114
Jan 25 13:18:36.867486 n-d-760454-3 sudo[119356]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:37.157881 n-d-760454-3 sudo[119352]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:37.160430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.208s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:37.161866 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:37.224183 n-d-760454-3 sudo[119360]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:18:37.232724 n-d-760454-3 sudo[119360]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:38.074484 n-d-760454-3 sudo[119356]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:38.077180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8d099c9c-6aef-468d-ae15-f076157ec114" returned: 0 in 1.308s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:38.078611 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Successfully deleted volume: 8d099c9c-6aef-468d-ae15-f076157ec114
Jan 25 13:18:38.205231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Created reservations ['5b03b286-5bcc-4dba-aa2c-17237dcd3b11', 'e57247ac-6fdd-4ee8-98ca-3bef0565010a', '5fb69ae3-ba61-4c3d-907e-3bf2814fd408', 'b93ec9ac-84b4-4340-ab42-65e695a2833f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:18:38.211988 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:18:38.211988 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:18:38.211988 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:18:38.381867 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:18:38.382795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:38.450075 n-d-760454-3 sudo[119360]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:38.452576 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.290s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:38.454318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:18:38.475526 n-d-760454-3 sudo[119371]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:18:38.479906 n-d-760454-3 sudo[119371]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:39.099379 n-d-760454-3 sudo[119371]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:39.217213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:39.253206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.870s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:39.255855 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:39.274022 n-d-760454-3 sudo[119375]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51
Jan 25 13:18:39.278298 n-d-760454-3 sudo[119375]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:39.306473 n-d-760454-3 sudo[119376]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:18:39.310481 n-d-760454-3 sudo[119376]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:39.979500 n-d-760454-3 sudo[119375]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:39.982701 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/mapper/stack--volumes--lvmdriver--1-volume--f78fad85--32b3--4c14--9de1--1781f62f2b51" returned: 0 in 0.765s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:39.984240 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] Uploaded volume to glance image-id: 26410685-d31f-4958-b202-1bf9180c44dd. {{(pid=89244) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1672}}
Jan 25 13:18:40.130421 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-01f520f1-69ec-47af-a09e-ceaac34c5c82 tempest-VolumesActionsTest-540514637 None] Copy volume to image completed successfully.
Jan 25 13:18:40.450514 n-d-760454-3 sudo[119376]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:40.453330 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.197s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:40.454202 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:18:40.459099 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Deleted volume successfully.
Jan 25 13:18:40.519328 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ae316644-3534-40e8-b1f5-fd5d8e444df7 tempest-ServersNegativeTestJSON-380865974 None] Lock "b'cinder-8d099c9c-6aef-468d-ae15-f076157ec114-delete_volume'" released by "delete_volume" :: held 6.364s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:18:43.223844 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:18:43.440410 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Skipping remove_export. No iscsi_target is presently exported for volume: f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:18:43.443213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:43.493657 n-d-760454-3 sudo[119383]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:18:43.494463 n-d-760454-3 sudo[119383]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:44.539895 n-d-760454-3 sudo[119383]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:44.544200 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51" returned: 0 in 1.101s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:44.550512 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:44.597903 n-d-760454-3 sudo[119401]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:18:44.598523 n-d-760454-3 sudo[119401]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:45.564397 n-d-760454-3 sudo[119401]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:45.566990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51" returned: 0 in 1.016s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:45.568758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:45.642718 n-d-760454-3 sudo[119488]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:18:45.643246 n-d-760454-3 sudo[119488]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:46.668813 n-d-760454-3 sudo[119488]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:46.671368 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f78fad85-32b3-4c14-9de1-1781f62f2b51" returned: 0 in 1.102s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:46.672972 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Successfully deleted volume: f78fad85-32b3-4c14-9de1-1781f62f2b51
Jan 25 13:18:46.850468 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Created reservations ['4cd1a638-b3cb-4edf-babc-e453bdca7cc0', '6cbb5f12-809a-4d72-b1b6-82d11ccd210a', 'f8881610-7bcf-4153-938c-7121ecdab15f', '9e57aafa-bbd4-4cb0-9991-0d046fd5d195'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:18:46.853501 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:18:46.853501 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:18:46.853501 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:18:46.981678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:18:46.982732 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:47.029026 n-d-760454-3 sudo[119562]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:18:47.029757 n-d-760454-3 sudo[119562]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:47.656794 n-d-760454-3 sudo[119562]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:47.659969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:47.662354 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:18:47.697933 n-d-760454-3 sudo[119570]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:18:47.698476 n-d-760454-3 sudo[119570]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:18:48.839867 n-d-760454-3 sudo[119570]: pam_unix(sudo:session): session closed for user root
Jan 25 13:18:48.842258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.179s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:18:48.844101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:18:48.862412 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Deleted volume successfully.
Jan 25 13:18:48.912819 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5e725419-1b49-4a13-8e9c-eebef97c2642 tempest-VolumesActionsTest-540514637 None] Lock "b'cinder-f78fad85-32b3-4c14-9de1-1781f62f2b51-delete_volume'" released by "delete_volume" :: held 5.689s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:19:00.819370 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:19:00.827300 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:19:00.827873 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:19:00.862478 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Flow 'volume_create_manager' (4b78117a-993f-4e54-9b09-526c7c858665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:19:00.867128 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d50cf6e-6f14-4efd-8801-7c7556ca6293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:00.896410 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:19:00.935204 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d50cf6e-6f14-4efd-8801-7c7556ca6293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-89376510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965ff9b4c704fca91598d3b9eb70e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:19:01Z,user_id='4c092284a935470195b6c3272541c73b',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:00.939305 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399d5de4-b1a2-4e9d-9c8b-a4f570c600de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:00.943484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399d5de4-b1a2-4e9d-9c8b-a4f570c600de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:00.949165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d6d50-80cd-4a3e-8e10-89148b081ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:01.116345 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d6d50-80cd-4a3e-8e10-89148b081ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71', 'volume_name': 'volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c345d68>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:01.118850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e402e7f-8d56-4c45-b342-0994e9ca301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:01.139294 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e402e7f-8d56-4c45-b342-0994e9ca301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:01.141749 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52864531-22e1-4082-9f28-0a7d5847061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:01.142665 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Volume 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c345d68>}
Jan 25 13:19:01.143399 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Cloning 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:19:21.638554 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 20.49 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:19:21.639852 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Image download 616.00 MB at 30.06 MB/s
Jan 25 13:19:21.700714 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:21.815335 n-d-760454-3 sudo[120042]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1
Jan 25 13:19:21.815964 n-d-760454-3 sudo[120042]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:22.552408 n-d-760454-3 sudo[120042]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:22.555130 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1" returned: 0 in 0.854s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:22.555960 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 4c092284a935470195b6c3272541c73b. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:19:22.764344 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:23.007613 n-d-760454-3 sudo[120056]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1
Jan 25 13:19:23.008174 n-d-760454-3 sudo[120056]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:23.444401 n-d-760454-3 sudo[120056]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:23.449887 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1" returned: 0 in 0.682s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:23.449887 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:23.480274 n-d-760454-3 sudo[120060]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:19:23.480895 n-d-760454-3 sudo[120060]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:24.422686 n-d-760454-3 sudo[120060]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:24.425228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.975s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:24.552768 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:19:24.623750 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxzvcdftu {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:24.838150 n-d-760454-3 sudo[120091]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxzvcdftu
Jan 25 13:19:24.838718 n-d-760454-3 sudo[120091]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:25.351200 n-d-760454-3 sudo[120091]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:25.356356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxzvcdftu" returned: 0 in 0.731s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:25.358434 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:25.486228 n-d-760454-3 sudo[120094]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1
Jan 25 13:19:25.487430 n-d-760454-3 sudo[120094]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:26.000448 n-d-760454-3 sudo[120094]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:26.008492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1" returned: 0 in 0.644s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:26.008492 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:19:26.008492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:26.025616 n-d-760454-3 sudo[120098]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71 oflag=direct
Jan 25 13:19:26.026774 n-d-760454-3 sudo[120098]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:26.582770 n-d-760454-3 sudo[120098]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:26.587429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71 oflag=direct" returned: 0 in 0.580s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:26.590350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:26.621748 n-d-760454-3 sudo[120108]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71
Jan 25 13:19:26.625177 n-d-760454-3 sudo[120108]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:35.953609 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:19:35.955191 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:19:35.957343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:35.983577 n-d-760454-3 sudo[120180]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:19:35.984217 n-d-760454-3 sudo[120180]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:36.425717 n-d-760454-3 sudo[120180]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:36.446916 n-d-760454-3 sudo[120184]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:19:36.455934 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:36.455934 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:36.447446 n-d-760454-3 sudo[120184]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:37.276688 n-d-760454-3 sudo[120184]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:37.279259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.850s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:37.282289 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:19:44.594048 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-86e45f9d-07bb-47a1-b506-1e2f735cddd1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Terminate volume connection completed successfully.
Jan 25 13:19:44.594510 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-86e45f9d-07bb-47a1-b506-1e2f735cddd1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleting attachment e2e7567c-785e-4aa1-b567-30e7b387e51d. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:19:44.603462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:44.905154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.306s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:44.905960 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8\n            Backing store flags: \n    Account information:\n        LC9eGp2bsRTmJUtzvHqt\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:44.906803 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-86e45f9d-07bb-47a1-b506-1e2f735cddd1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Removing iscsi_target for Volume ID: 784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:19:44.910171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:45.094469 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 -f" returned: 0 in 0.186s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:45.095258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:45.096920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:45.244501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.147s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:45.244978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:45.484068 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-86e45f9d-07bb-47a1-b506-1e2f735cddd1 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:19:45.484068 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:19:45.484068 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:19:45.927030 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-2a09f19b-2898-4f54-9201-44ecb82bc1d1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Terminate volume connection completed successfully.
Jan 25 13:19:45.950511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-2a09f19b-2898-4f54-9201-44ecb82bc1d1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleting attachment eace1080-ec8c-4f93-9a1e-26d1caa0de21. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:19:45.954114 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:46.112425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.143s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:46.112425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4\n            Backing store flags: \n    Account information:\n        8zNckbrCGhTWJsGMond2\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:46.112425 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-2a09f19b-2898-4f54-9201-44ecb82bc1d1 tempest-TaggedBootDevicesTest_v242-1532200539 None] Removing iscsi_target for Volume ID: 75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:19:46.112425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:46.212332 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 -f" returned: 0 in 0.111s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:46.215009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:46.219665 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:46.328104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.110s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:46.328876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:46.627732 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-2a09f19b-2898-4f54-9201-44ecb82bc1d1 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:19:46.627732 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:19:46.627732 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:19:46.942569 n-d-760454-3 sudo[120108]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:46.956881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71" returned: 0 in 20.358s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:46.956881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:47.017419 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-14eb7920-954a-4cd3-880e-a8586b44b448 tempest-TaggedBootDevicesTest_v242-1532200539 None] Terminate volume connection completed successfully.
Jan 25 13:19:47.018216 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-14eb7920-954a-4cd3-880e-a8586b44b448 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleting attachment 7127a703-01a3-4fb0-bd15-705cb4b66e66. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:19:47.020496 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:47.059315 n-d-760454-3 sudo[120290]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1
Jan 25 13:19:47.060364 n-d-760454-3 sudo[120290]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:47.141260 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:47.141597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86\n            Backing store flags: \n    Account information:\n        PC4aQRCMeCv6SKGVFHu4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:47.142297 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-14eb7920-954a-4cd3-880e-a8586b44b448 tempest-TaggedBootDevicesTest_v242-1532200539 None] Removing iscsi_target for Volume ID: 0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:19:47.144077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:47.302873 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 -f" returned: 0 in 0.158s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:47.303365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:47.306762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:47.421332 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.115s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:47.421892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357296]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:19:47.520668 n-d-760454-3 sudo[120290]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:47.522867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1" returned: 0 in 0.573s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:47.524175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpmezuzbzsn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 20.36 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--1a7c24e7--1dc0--4c1b--b8b2--c7c931473b71 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:19:47.524607 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Converted 700.00 MB image at 34.38 MB/s
Jan 25 13:19:47.525207 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:19:47.646243 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 4c092284a935470195b6c3272541c73b is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:19:47.646978 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Marking volume 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:19:47.657982 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-0e7e4677-debc-41a3-aea5-d866ce480fcc req-14eb7920-954a-4cd3-880e-a8586b44b448 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:19:47.657982 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:19:47.657982 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:19:47.706509 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:19:47.706997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Creating volume glance metadata for volume 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:19:47.921514 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52864531-22e1-4082-9f28-0a7d5847061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c345d68>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:47.929056 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa82c48-2082-4116-b4b1-7355413ab461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:47.975495 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Volume volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 (1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71): created successfully
Jan 25 13:19:47.987325 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa82c48-2082-4116-b4b1-7355413ab461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:48.005310 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Flow 'volume_create_manager' (4b78117a-993f-4e54-9b09-526c7c858665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:19:48.043530 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-331e3dbb-b9f3-415e-b764-304414c2a078 tempest-VolumesExtendTest-2057593584 None] Created volume successfully.
Jan 25 13:19:48.951409 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3dedefdf-6868-49b2-91b6-d72237b2de71 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:48.988970 n-d-760454-3 sudo[120311]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:19:49.001132 n-d-760454-3 sudo[120311]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:49.443524 n-d-760454-3 sudo[120311]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:49.446288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3dedefdf-6868-49b2-91b6-d72237b2de71 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71" returned: 0 in 0.494s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:49.447381 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3dedefdf-6868-49b2-91b6-d72237b2de71 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:49.466278 n-d-760454-3 sudo[120316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:19:49.466835 n-d-760454-3 sudo[120316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:50.316598 n-d-760454-3 sudo[120316]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:50.318839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3dedefdf-6868-49b2-91b6-d72237b2de71 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71" returned: 0 in 0.871s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:50.466664 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3dedefdf-6868-49b2-91b6-d72237b2de71 tempest-VolumesExtendTest-2057593584 None] Extend volume completed successfully.
Jan 25 13:19:52.656856 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:19:52.662292 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:19:52.665641 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:19:52.678549 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Flow 'volume_create_manager' (caa20c2e-5f0f-4ddb-a49e-0cfa374b29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:19:52.683623 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf96e196-3a0e-4d12-870f-3c820ae28b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:52.723111 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:19:52.769873 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf96e196-3a0e-4d12-870f-3c820ae28b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1028289067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=a645e0a4-2202-439e-846f-60a4dfec77ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c965ff9b4c704fca91598d3b9eb70e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:19:52Z,user_id='4c092284a935470195b6c3272541c73b',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:52.773086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4c144a-2b54-45b5-b3d9-63655ece1266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:52.776163 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4c144a-2b54-45b5-b3d9-63655ece1266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:52.779817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a31c47-6797-433d-9d28-3c8ae3600187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:52.783448 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a31c47-6797-433d-9d28-3c8ae3600187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a645e0a4-2202-439e-846f-60a4dfec77ec', 'volume_name': 'volume-a645e0a4-2202-439e-846f-60a4dfec77ec', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:52.787043 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ef635-910e-4e78-89fa-79b6bf9d103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:52.791354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ef635-910e-4e78-89fa-79b6bf9d103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:52.794196 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c618ef2-0654-47a8-8661-942fd9002fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:52.795474 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Volume a645e0a4-2202-439e-846f-60a4dfec77ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a645e0a4-2202-439e-846f-60a4dfec77ec', 'volume_size': 1}
Jan 25 13:19:52.796910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a645e0a4-2202-439e-846f-60a4dfec77ec stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:52.837516 n-d-760454-3 sudo[120336]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a645e0a4-2202-439e-846f-60a4dfec77ec stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:19:52.838696 n-d-760454-3 sudo[120336]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:53.796151 n-d-760454-3 sudo[120336]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:53.798596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-a645e0a4-2202-439e-846f-60a4dfec77ec stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.001s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:53.804527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c618ef2-0654-47a8-8661-942fd9002fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a645e0a4-2202-439e-846f-60a4dfec77ec', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:53.817069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e840473-c6fc-4255-8888-063ba86a7069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:19:53.862047 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Volume volume-a645e0a4-2202-439e-846f-60a4dfec77ec (a645e0a4-2202-439e-846f-60a4dfec77ec): created successfully
Jan 25 13:19:53.865533 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e840473-c6fc-4255-8888-063ba86a7069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:19:53.870331 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Flow 'volume_create_manager' (caa20c2e-5f0f-4ddb-a49e-0cfa374b29d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:19:53.918567 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-033b155f-b34a-45fd-b885-efa8de504186 tempest-VolumesExtendTest-2057593584 None] Created volume successfully.
Jan 25 13:19:55.510860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fb259a7a-828e-465e-8361-dbed64a2368b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:55.555748 n-d-760454-3 sudo[120371]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:19:55.557087 n-d-760454-3 sudo[120371]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:56.446218 n-d-760454-3 sudo[120371]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:56.449393 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fb259a7a-828e-465e-8361-dbed64a2368b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.938s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:56.450502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fb259a7a-828e-465e-8361-dbed64a2368b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd --snapshot stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:56.482165 n-d-760454-3 sudo[120375]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd --snapshot stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec -L 1.00g
Jan 25 13:19:56.483490 n-d-760454-3 sudo[120375]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:57.631110 n-d-760454-3 sudo[120375]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:57.636611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fb259a7a-828e-465e-8361-dbed64a2368b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd --snapshot stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec -L 1.00g" returned: 0 in 1.184s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:57.769110 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fb259a7a-828e-465e-8361-dbed64a2368b tempest-VolumesExtendTest-2057593584 None] Create snapshot completed successfully
Jan 25 13:19:58.991101 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:59.019750 n-d-760454-3 sudo[120501]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:19:59.021274 n-d-760454-3 sudo[120501]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:19:59.465051 n-d-760454-3 sudo[120501]: pam_unix(sudo:session): session closed for user root
Jan 25 13:19:59.468138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.476s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:19:59.470710 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a n stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:19:59.493143 n-d-760454-3 sudo[120506]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a n stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:19:59.493880 n-d-760454-3 sudo[120506]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:00.015330 n-d-760454-3 sudo[120506]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:00.020068 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a n stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.547s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:00.021801 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.brick.local_dev.lvm [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Checking to see if volume volume-a645e0a4-2202-439e-846f-60a4dfec77ec has been deactivated. {{(pid=89244) _wait_for_volume_deactivation /opt/stack/cinder/cinder/brick/local_dev/lvm.py:660}}
Jan 25 13:20:00.022876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:00.067907 n-d-760454-3 sudo[120526]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:00.068498 n-d-760454-3 sudo[120526]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:00.720746 n-d-760454-3 sudo[120526]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:00.723182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.700s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:00.724001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.brick.local_dev.lvm [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Volume volume-a645e0a4-2202-439e-846f-60a4dfec77ec has been deactivated. {{(pid=89244) _wait_for_volume_deactivation /opt/stack/cinder/cinder/brick/local_dev/lvm.py:665}}
Jan 25 13:20:00.726679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:00.760303 n-d-760454-3 sudo[120540]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:00.761505 n-d-760454-3 sudo[120540]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:01.420363 n-d-760454-3 sudo[120540]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:01.422653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvextend -L 2g stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.696s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:01.424224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:01.488583 n-d-760454-3 sudo[120546]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:01.489385 n-d-760454-3 sudo[120546]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:02.148496 n-d-760454-3 sudo[120546]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:02.150763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.726s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:02.426605 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f77eeb3f-a478-441f-b133-3a6bd81d76d3 tempest-VolumesExtendTest-2057593584 None] Extend volume completed successfully.
Jan 25 13:20:03.129886 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-6fbe4194-a8ef-424f-9e4f-300bacafadcd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:03.137390 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:03.179479 n-d-760454-3 sudo[120635]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd
Jan 25 13:20:03.188736 n-d-760454-3 sudo[120635]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:03.874197 n-d-760454-3 sudo[120635]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:03.876883 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd" returned: 0 in 0.740s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:03.879578 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:03.923666 n-d-760454-3 sudo[120643]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd
Jan 25 13:20:03.924490 n-d-760454-3 sudo[120643]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:04.991036 n-d-760454-3 sudo[120643]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:04.993748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-6fbe4194-a8ef-424f-9e4f-300bacafadcd" returned: 0 in 1.114s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:05.221698 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Created reservations ['bc03820b-63de-4a7c-bfae-110e7dfacef1', '8d2b278e-9d44-4560-a5e8-aaa9325fcfdb', '3c4c96f5-909d-4cdb-b102-27548009f723', 'eda07df1-34b2-4250-bd97-e45cd02e2cef'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:05.224943 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:05.224943 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:05.224943 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:05.380628 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Delete snapshot completed successfully.
Jan 25 13:20:05.389242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b6213694-6d9c-4327-a873-62c6b216d82d tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-6fbe4194-a8ef-424f-9e4f-300bacafadcd-delete_snapshot'" released by "delete_snapshot" :: held 2.260s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:05.634046 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-a645e0a4-2202-439e-846f-60a4dfec77ec-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:05.818750 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Skipping remove_export. No iscsi_target is presently exported for volume: a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:05.820247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:05.857167 n-d-760454-3 sudo[120691]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:05.857853 n-d-760454-3 sudo[120691]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:06.714979 n-d-760454-3 sudo[120691]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:06.718134 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.897s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:06.721165 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:06.762339 n-d-760454-3 sudo[120697]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:06.763888 n-d-760454-3 sudo[120697]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:07.505192 n-d-760454-3 sudo[120697]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:07.510136 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.788s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:07.514174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:07.556645 n-d-760454-3 sudo[120701]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:07.566989 n-d-760454-3 sudo[120701]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:08.398503 n-d-760454-3 sudo[120701]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:08.405641 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-a645e0a4-2202-439e-846f-60a4dfec77ec" returned: 0 in 0.887s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:08.405641 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Successfully deleted volume: a645e0a4-2202-439e-846f-60a4dfec77ec
Jan 25 13:20:08.536386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Created reservations ['a5ab6844-2334-454c-aa22-7f6269ad022b', 'fd2418d0-e09b-4614-b315-a29c2cb09f4e', '6018eda8-df77-4e6e-b377-de03d4325b34', '7c3674b6-7bea-41b5-a6e8-9b23fddd92cf'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:08.539753 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:08.539753 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:08.539753 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:08.700195 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:08.701572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:08.735001 n-d-760454-3 sudo[120710]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:08.736568 n-d-760454-3 sudo[120710]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:09.282383 n-d-760454-3 sudo[120710]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:09.285108 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:09.287531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:09.308442 n-d-760454-3 sudo[120714]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:09.309712 n-d-760454-3 sudo[120714]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:09.960856 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71-delete_volume'" acquired by "delete_volume" :: waited 0.047s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:10.218098 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Skipping remove_export. No iscsi_target is presently exported for volume: 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:20:10.219175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:10.259722 n-d-760454-3 sudo[120718]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:20:10.270071 n-d-760454-3 sudo[120718]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:10.538866 n-d-760454-3 sudo[120714]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:10.541844 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.254s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:10.544058 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:20:10.551796 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Deleted volume successfully.
Jan 25 13:20:10.598595 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5c4032ce-4f20-466a-be5a-99c17ded0480 tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-a645e0a4-2202-439e-846f-60a4dfec77ec-delete_volume'" released by "delete_volume" :: held 4.964s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:11.146614 n-d-760454-3 sudo[120718]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:11.149445 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71" returned: 0 in 0.930s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:11.151748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:11.172601 n-d-760454-3 sudo[120722]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:20:11.173761 n-d-760454-3 sudo[120722]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:11.876410 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-0668b208-9770-4c5e-95db-0f55e2e9ac86-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:12.125532 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:12.138099 n-d-760454-3 sudo[120722]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:12.140279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71" returned: 0 in 0.989s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:12.142779 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:12.183742 n-d-760454-3 sudo[120727]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:20:12.184288 n-d-760454-3 sudo[120727]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:12.357497 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.233s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:12.358104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:20:12.359705 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Skipping remove_export. No iscsi_target is presently exported for volume: 0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:20:12.361410 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:12.399839 n-d-760454-3 sudo[120730]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:20:12.405229 n-d-760454-3 sudo[120730]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:12.962003 n-d-760454-3 sudo[120727]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:12.964770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71" returned: 0 in 0.822s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:12.966961 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Successfully deleted volume: 1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71
Jan 25 13:20:13.118325 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Created reservations ['03894e7d-7443-40ac-9174-2d1d0ca68853', 'd22f486b-51f6-4893-ba63-0cb4c5de1b10', 'e448ad16-387e-4d8f-8bcd-e512d5e9708a', '5ddb3839-9fe7-4b1d-90ea-576d03185d75'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:13.121029 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:13.121029 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:13.121029 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:13.306350 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:13.307459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:13.377235 n-d-760454-3 sudo[120741]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:13.379051 n-d-760454-3 sudo[120741]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:13.539528 n-d-760454-3 sudo[120730]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:13.541971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86" returned: 0 in 1.181s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:13.543463 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:13.576164 n-d-760454-3 sudo[120743]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:20:13.577295 n-d-760454-3 sudo[120743]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:14.326385 n-d-760454-3 sudo[120741]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:14.328900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.021s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:14.331041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:14.340104 n-d-760454-3 sudo[120743]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:14.354929 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86" returned: 0 in 0.811s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:14.357184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:14.368824 n-d-760454-3 sudo[120758]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:14.370062 n-d-760454-3 sudo[120758]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:14.405612 n-d-760454-3 sudo[120762]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:20:14.406767 n-d-760454-3 sudo[120762]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:15.676696 n-d-760454-3 sudo[120758]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:15.681132 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.349s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:15.683960 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:20:15.692686 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Deleted volume successfully.
Jan 25 13:20:15.704679 n-d-760454-3 sudo[120762]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:15.710139 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0668b208-9770-4c5e-95db-0f55e2e9ac86" returned: 0 in 1.353s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:15.711219 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Successfully deleted volume: 0668b208-9770-4c5e-95db-0f55e2e9ac86
Jan 25 13:20:15.816927 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-747354bb-edd1-4012-a151-bc2f98d5513b tempest-VolumesExtendTest-2057593584 None] Lock "b'cinder-1a7c24e7-1dc0-4c1b-b8b2-c7c931473b71-delete_volume'" released by "delete_volume" :: held 5.857s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:15.865608 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created reservations ['f4304c3b-92cb-4e15-bb16-5e69e536bfb8', 'ea907206-2969-46b5-825a-36d1ec731103', 'a5f8305c-1817-4ca4-8bd6-2b5ecac241cf', 'faf1944a-5ff6-4de0-ba41-bd54717a4610'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:15.869989 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:15.869989 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:15.869989 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:16.089169 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:16.090258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:16.130843 n-d-760454-3 sudo[120822]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:16.132076 n-d-760454-3 sudo[120822]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:16.649454 n-d-760454-3 sudo[120822]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:16.651802 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:16.654038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:16.682483 n-d-760454-3 sudo[120830]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:16.683579 n-d-760454-3 sudo[120830]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:17.180470 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-75dcbed8-429b-4bb0-8ac0-20d98326d7a4-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:17.466064 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:17.683471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.221s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:17.684286 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:20:17.685591 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Skipping remove_export. No iscsi_target is presently exported for volume: 75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:20:17.689702 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:17.728996 n-d-760454-3 sudo[120845]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:20:17.729607 n-d-760454-3 sudo[120845]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:17.744237 n-d-760454-3 sudo[120830]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:17.746822 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.092s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:17.748660 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:20:17.766000 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleted volume successfully.
Jan 25 13:20:17.882443 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-5cbfe30d-6127-46a4-88c5-40a56838c409 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-0668b208-9770-4c5e-95db-0f55e2e9ac86-delete_volume'" released by "delete_volume" :: held 6.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:18.998747 n-d-760454-3 sudo[120845]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:19.002048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4" returned: 0 in 1.315s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:19.003083 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:19.036259 n-d-760454-3 sudo[120861]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:20:19.036886 n-d-760454-3 sudo[120861]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:19.888055 n-d-760454-3 sudo[120861]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:19.891062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4" returned: 0 in 0.888s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:19.895162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:19.931167 n-d-760454-3 sudo[120865]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:20:19.932477 n-d-760454-3 sudo[120865]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:20.852589 n-d-760454-3 sudo[120865]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:20.858633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-75dcbed8-429b-4bb0-8ac0-20d98326d7a4" returned: 0 in 0.960s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:20.858633 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Successfully deleted volume: 75dcbed8-429b-4bb0-8ac0-20d98326d7a4
Jan 25 13:20:21.168798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created reservations ['77ff356a-e318-46c9-80e5-8e2c04fd6dcb', '7706cbf1-d377-4201-be4a-87d6c9bd9b7e', 'c5b14821-a72a-4b3b-91e0-75fae80adcdd', '6628b0ab-ae7d-406b-8e7e-90d16f258127'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:21.171240 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:21.171240 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:21.171240 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:21.305588 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:21.306444 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:21.354339 n-d-760454-3 sudo[120874]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:21.355149 n-d-760454-3 sudo[120874]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:22.119205 n-d-760454-3 sudo[120874]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:22.122611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.815s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:22.125941 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:22.181890 n-d-760454-3 sudo[120878]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:22.185210 n-d-760454-3 sudo[120878]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:22.918592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-784dddce-13d7-4bd9-bbe6-e20f6744b4a8-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:20:23.096642 n-d-760454-3 sudo[120878]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:23.108803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.983s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:23.110412 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:20:23.150349 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleted volume successfully.
Jan 25 13:20:23.276919 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a3d03e49-5e6a-43f9-99d1-1f41619e0c65 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-75dcbed8-429b-4bb0-8ac0-20d98326d7a4-delete_volume'" released by "delete_volume" :: held 6.097s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:23.279624 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:23.516049 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.243s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:23.517036 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:20:23.517765 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Skipping remove_export. No iscsi_target is presently exported for volume: 784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:20:23.518656 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:23.558031 n-d-760454-3 sudo[120891]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:20:23.559397 n-d-760454-3 sudo[120891]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:24.142779 n-d-760454-3 sudo[120891]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:24.145167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8" returned: 0 in 0.626s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:24.149154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:24.169902 n-d-760454-3 sudo[120919]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:20:24.171235 n-d-760454-3 sudo[120919]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:24.708292 n-d-760454-3 sudo[120919]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:24.711433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8" returned: 0 in 0.562s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:24.713773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:24.771867 n-d-760454-3 sudo[120930]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:20:24.772729 n-d-760454-3 sudo[120930]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:25.576603 n-d-760454-3 sudo[120930]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:25.579029 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-784dddce-13d7-4bd9-bbe6-e20f6744b4a8" returned: 0 in 0.865s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:25.581443 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Successfully deleted volume: 784dddce-13d7-4bd9-bbe6-e20f6744b4a8
Jan 25 13:20:25.677455 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Created reservations ['8d383b2c-c766-401e-ba57-79087befb0b9', '8bb39c55-e894-4efe-bfdc-f50fc436a618', 'f79c753d-6262-4a45-b598-7d0eec2e0014', '6491715e-0200-4319-81bf-aa36af2a4a6b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:20:25.682438 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:20:25.682438 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:20:25.682438 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:20:25.842873 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:25.844632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:25.907920 n-d-760454-3 sudo[120956]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:25.908477 n-d-760454-3 sudo[120956]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:26.579495 n-d-760454-3 sudo[120956]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:26.582034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:26.584968 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:26.621081 n-d-760454-3 sudo[120960]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:26.621639 n-d-760454-3 sudo[120960]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:27.778401 n-d-760454-3 sudo[120960]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:27.781006 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.196s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:27.784349 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:20:27.812842 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Deleted volume successfully.
Jan 25 13:20:27.899077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-0c826619-aaa4-40cc-a700-85d8dda0d145 tempest-TaggedBootDevicesTest_v242-1532200539 None] Lock "b'cinder-784dddce-13d7-4bd9-bbe6-e20f6744b4a8-delete_volume'" released by "delete_volume" :: held 4.983s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:20:35.953587 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:20:35.954018 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:20:35.954814 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:35.992852 n-d-760454-3 sudo[121181]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:20:35.993462 n-d-760454-3 sudo[121181]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:36.657261 n-d-760454-3 sudo[121181]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:36.659771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:36.661056 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:20:36.690501 n-d-760454-3 sudo[121196]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:20:36.691717 n-d-760454-3 sudo[121196]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:20:37.549921 n-d-760454-3 sudo[121196]: pam_unix(sudo:session): session closed for user root
Jan 25 13:20:37.552979 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.891s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:20:37.554392 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:21:02.543066 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:21:02.572840 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:21:02.574395 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:21:02.640989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Flow 'volume_create_manager' (54b0157f-7357-4b94-8b12-91afc496b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:21:02.649146 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f56b6c-51d1-4402-8b77-04c38ec41c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:02.709961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:21:02.803565 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f56b6c-51d1-4402-8b77-04c38ec41c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-458849196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c2332e12-ec00-451e-89fc-3a4e9a0cdf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadf9f3f7fd54d20a97b01a719e61cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:21:02Z,user_id='7869a4f710db41d2becc18dce6070b63',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:02.807034 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b158dca1-8b53-4df2-ba06-b62dcb0a0bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:02.816297 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b158dca1-8b53-4df2-ba06-b62dcb0a0bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:02.826688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a51df3-5b40-4157-8636-1efb7f16b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:03.176243 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a51df3-5b40-4157-8636-1efb7f16b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2332e12-ec00-451e-89fc-3a4e9a0cdf4c', 'volume_name': 'volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c396470>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:03.185166 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8aa6fa3-026b-4c67-8faa-3a76bfd276bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:03.201435 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8aa6fa3-026b-4c67-8faa-3a76bfd276bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:03.206393 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39613227-28ef-4c06-a76c-46fbf2d32c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:03.208568 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Volume c2332e12-ec00-451e-89fc-3a4e9a0cdf4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c396470>}
Jan 25 13:21:03.209934 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Cloning c2332e12-ec00-451e-89fc-3a4e9a0cdf4c from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:21:26.874255 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 23.66 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:21:26.875787 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Image download 616.00 MB at 26.03 MB/s
Jan 25 13:21:26.949097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:27.051031 n-d-760454-3 sudo[122091]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1
Jan 25 13:21:27.051635 n-d-760454-3 sudo[122091]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:27.572437 n-d-760454-3 sudo[122091]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:27.575031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1" returned: 0 in 0.626s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:27.576251 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 7869a4f710db41d2becc18dce6070b63. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:21:27.727763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:27.961157 n-d-760454-3 sudo[122095]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1
Jan 25 13:21:27.969143 n-d-760454-3 sudo[122095]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:28.806136 n-d-760454-3 sudo[122095]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:28.808481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1" returned: 0 in 1.081s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:28.812035 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:28.857753 n-d-760454-3 sudo[122103]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:21:28.858585 n-d-760454-3 sudo[122103]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:30.021927 n-d-760454-3 sudo[122103]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:30.024973 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.213s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:30.127225 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume c2332e12-ec00-451e-89fc-3a4e9a0cdf4c. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:21:30.243136 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpaz8q2tie {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:30.543625 n-d-760454-3 sudo[122176]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpaz8q2tie
Jan 25 13:21:30.547546 n-d-760454-3 sudo[122176]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:31.211502 n-d-760454-3 sudo[122176]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:31.214104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpaz8q2tie" returned: 0 in 0.973s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:31.219050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:31.354642 n-d-760454-3 sudo[122208]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1
Jan 25 13:21:31.356332 n-d-760454-3 sudo[122208]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:31.924482 n-d-760454-3 sudo[122208]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:31.927190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1" returned: 0 in 0.708s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:31.929721 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:21:31.931300 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:31.960520 n-d-760454-3 sudo[122214]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c oflag=direct
Jan 25 13:21:31.963349 n-d-760454-3 sudo[122214]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:32.510221 n-d-760454-3 sudo[122214]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:32.514938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c oflag=direct" returned: 0 in 0.584s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:32.517639 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:32.541834 n-d-760454-3 sudo[122229]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c
Jan 25 13:21:32.543051 n-d-760454-3 sudo[122229]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:35.954071 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:21:35.955283 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:21:35.957161 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:35.981506 n-d-760454-3 sudo[122259]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:21:35.982497 n-d-760454-3 sudo[122259]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:36.366327 n-d-760454-3 sudo[122259]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:36.368564 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:36.369969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:36.388718 n-d-760454-3 sudo[122263]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:21:36.389710 n-d-760454-3 sudo[122263]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:37.083653 n-d-760454-3 sudo[122263]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:37.085766 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:37.087469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:21:52.402957 n-d-760454-3 sudo[122229]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:52.409466 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c" returned: 0 in 19.891s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:52.412977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:21:52.630445 n-d-760454-3 sudo[122349]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1
Jan 25 13:21:52.631024 n-d-760454-3 sudo[122349]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:21:53.181665 n-d-760454-3 sudo[122349]: pam_unix(sudo:session): session closed for user root
Jan 25 13:21:53.185511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1" returned: 0 in 0.773s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:21:53.187364 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmp_wa8vfgpn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 19.89 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--c2332e12--ec00--451e--89fc--3a4e9a0cdf4c {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:21:53.188323 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Converted 700.00 MB image at 35.19 MB/s
Jan 25 13:21:53.190225 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume c2332e12-ec00-451e-89fc-3a4e9a0cdf4c successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:21:53.385493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 7869a4f710db41d2becc18dce6070b63 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:21:53.386574 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Marking volume c2332e12-ec00-451e-89fc-3a4e9a0cdf4c as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:21:53.445592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to c2332e12-ec00-451e-89fc-3a4e9a0cdf4c. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:21:53.446165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Creating volume glance metadata for volume c2332e12-ec00-451e-89fc-3a4e9a0cdf4c backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:21:53.667156 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39613227-28ef-4c06-a76c-46fbf2d32c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c396470>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:53.670074 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838fd9ed-114b-492d-9087-2f1aa9f98cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:21:53.731194 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Volume volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c (c2332e12-ec00-451e-89fc-3a4e9a0cdf4c): created successfully
Jan 25 13:21:53.733326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838fd9ed-114b-492d-9087-2f1aa9f98cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:21:53.738026 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Flow 'volume_create_manager' (54b0157f-7357-4b94-8b12-91afc496b65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:21:53.800021 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4d0e030a-e4a2-4ae3-b85a-39799924c285 tempest-TestVolumeBackupRestore-965971121 None] Created volume successfully.
Jan 25 13:22:00.323506 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Creating a new backup for volume volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:22:00.343987 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:00.368499 n-d-760454-3 sudo[122374]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:22:00.369206 n-d-760454-3 sudo[122374]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:22:00.789469 n-d-760454-3 sudo[122374]: pam_unix(sudo:session): session closed for user root
Jan 25 13:22:00.791671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c" returned: 0 in 0.447s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:00.854519 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:00.864557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.012s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:00.865063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:22:00.865911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:22:00.866961 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Creating iscsi_target for Volume ID: volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Created volume path /opt/stack/data/cinder/volumes/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c,
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c>
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:     incominguser eni7Zn3i9injSAJGebPm pGwQ2o3YVWdcEmGM
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:22:00.971418 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:22:00.976046 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:01.573034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c" returned: 0 in 0.598s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:01.574092 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:22:01.574984 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:22:01.575631 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:22:01.579212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:01.586890 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:01.587480 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n            Backing store flags: \n    Account information:\n        eni7Zn3i9injSAJGebPm\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:22:01.588374 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:22:01.591460 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:01.679175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.089s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:01.679849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n            Backing store flags: \n    Account information:\n        eni7Zn3i9injSAJGebPm\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:22:01.683248 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:01.802514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:01.803252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n            Backing store flags: \n    Account information:\n        eni7Zn3i9injSAJGebPm\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:22:01.804616 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:22:01.899664 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Initialize volume connection completed successfully.
Jan 25 13:22:35.956113 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:22:35.957773 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:22:35.959356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:35.997239 n-d-760454-3 sudo[122899]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:22:35.997992 n-d-760454-3 sudo[122899]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:22:36.579370 n-d-760454-3 sudo[122899]: pam_unix(sudo:session): session closed for user root
Jan 25 13:22:36.591664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:36.591664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:22:36.616018 n-d-760454-3 sudo[122903]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:22:36.617488 n-d-760454-3 sudo[122903]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:22:37.599147 n-d-760454-3 sudo[122903]: pam_unix(sudo:session): session closed for user root
Jan 25 13:22:37.601959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.018s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:22:37.603794 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:23:35.961503 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:23:35.962527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:23:35.962713 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:35.987134 n-d-760454-3 sudo[123492]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:23:35.987743 n-d-760454-3 sudo[123492]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:23:36.581254 n-d-760454-3 sudo[123492]: pam_unix(sudo:session): session closed for user root
Jan 25 13:23:36.584208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:23:36.587075 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:36.609569 n-d-760454-3 sudo[123496]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:23:36.610115 n-d-760454-3 sudo[123496]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:23:37.523458 n-d-760454-3 sudo[123496]: pam_unix(sudo:session): session closed for user root
Jan 25 13:23:37.528162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.940s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:23:37.531555 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:23:56.856687 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Terminate volume connection completed successfully.
Jan 25 13:23:56.972445 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:57.122456 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.151s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:23:57.122816 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354712]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c\n            Backing store flags: \n    Account information:\n        eni7Zn3i9injSAJGebPm\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:23:57.123532 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Removing iscsi_target for Volume ID: c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:23:57.126957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:57.449530 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c -f" returned: 0 in 0.324s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:23:57.450478 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354712]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:23:57.452020 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:57.556015 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.102s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:23:57.557304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354712]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:23:57.560090 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6a5bac8b-02fc-4381-88d3-141b5f79d3ac tempest-TestVolumeBackupRestore-965971121 None] Remove volume export completed successfully.
Jan 25 13:23:59.407992 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:23:59.415470 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:23:59.417733 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:23:59.442950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Flow 'volume_create_manager' (4dc8e62d-6ae1-4fd5-a94f-66eec07ca795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:23:59.448351 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd503870-1e25-43ec-add0-19be49dbcf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:23:59.485228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:23:59.546739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd503870-1e25-43ec-add0-19be49dbcf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:23:58Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_4806b91e-9537-42e9-813b-03b624a15356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c0b767bf-1f7e-4423-bc30-2f58e51cc8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadf9f3f7fd54d20a97b01a719e61cc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:23:59Z,user_id='7869a4f710db41d2becc18dce6070b63',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:23:59.551700 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a0a564-e23a-40af-a0a6-cd71aa9970ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:23:59.555619 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a0a564-e23a-40af-a0a6-cd71aa9970ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:23:59.560908 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd910ca-14ed-4c53-9e08-c0fefd947afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:23:59.566466 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd910ca-14ed-4c53-9e08-c0fefd947afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b767bf-1f7e-4423-bc30-2f58e51cc8af', 'volume_name': 'volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:23:59.571325 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0330eb2-74f4-44ce-a66e-057f624a4692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:23:59.578039 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0330eb2-74f4-44ce-a66e-057f624a4692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:23:59.584507 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c04324-a3bf-40d4-b853-07f0a7524c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:23:59.586428 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Volume c0b767bf-1f7e-4423-bc30-2f58e51cc8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af', 'volume_size': 1}
Jan 25 13:23:59.588582 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:23:59.627197 n-d-760454-3 sudo[123697]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:23:59.628498 n-d-760454-3 sudo[123697]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:00.728955 n-d-760454-3 sudo[123697]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:00.732838 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.144s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:00.738211 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c04324-a3bf-40d4-b853-07f0a7524c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:00.741429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0902c9c-7980-402f-b345-0e67e8f19966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:00.792100 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Volume volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af (c0b767bf-1f7e-4423-bc30-2f58e51cc8af): created successfully
Jan 25 13:24:00.797549 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0902c9c-7980-402f-b345-0e67e8f19966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:00.803885 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Flow 'volume_create_manager' (4dc8e62d-6ae1-4fd5-a94f-66eec07ca795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:00.851899 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Created volume successfully.
Jan 25 13:24:01.777825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:01.830995 n-d-760454-3 sudo[123745]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:24:01.832617 n-d-760454-3 sudo[123745]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:02.461221 n-d-760454-3 sudo[123745]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:02.463889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 0.686s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:02.577286 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:02.594419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.023s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:02.594798 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:02.595573 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:24:02.596990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Creating iscsi_target for Volume ID: volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Created volume path /opt/stack/data/cinder/volumes/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af,
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af>
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:     incominguser DwGNjSHubhXZB8oNESu7 X2sGqSH2RDXZ9SiV
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:24:02.837669 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:24:02.843372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:03.631956 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5cf7055c-fb53-4fe8-b010-d01977df0c48 tempest-BackendsCapabilitiesAdminTestsJSON-1754368248 None] Obtained capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 48.82, 'free_capacity_gb': 48.82, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:n-d-760454-3:stack-volumes-lvmdriver-1:default:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': False, 'thick_provisioning_support': True, 'total_volumes': 0, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89244) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4472}}
Jan 25 13:24:03.697899 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6503bdb-0467-4239-b23c-52a1ac81efd3 tempest-BackendsCapabilitiesAdminTestsJSON-1754368248 None] Obtained capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 48.82, 'free_capacity_gb': 48.82, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:n-d-760454-3:stack-volumes-lvmdriver-1:default:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': False, 'thick_provisioning_support': True, 'total_volumes': 0, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89244) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4472}}
Jan 25 13:24:03.702280 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 0.859s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:03.702897 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:03.704625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:24:03.705202 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:24:03.709180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:03.742613 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.035s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:03.743260 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:03.744339 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:24:03.747778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:03.898645 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.151s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:03.899164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:03.903521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:04.008309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.107s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:04.009445 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:04.010705 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:24:04.106407 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Initialize volume connection completed successfully.
Jan 25 13:24:23.771797 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a340f534-40e8-4223-9f75-b9348df198a9 tempest-GroupsTest-1891553318 None] Group tempest-Group1-618758685: creating
Jan 25 13:24:23.928117 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a340f534-40e8-4223-9f75-b9348df198a9 tempest-GroupsTest-1891553318 None] Group tempest-Group1-618758685: created successfully
Jan 25 13:24:24.105649 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a340f534-40e8-4223-9f75-b9348df198a9 tempest-GroupsTest-1891553318 None] Create group completed successfully.
Jan 25 13:24:25.494854 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c8c2619c-8d76-45c6-af04-607670b98a26 tempest-GroupsTest-1891553318 None] Group tempest-Group2-1369883894: creating
Jan 25 13:24:25.650641 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c8c2619c-8d76-45c6-af04-607670b98a26 tempest-GroupsTest-1891553318 None] Group tempest-Group2-1369883894: created successfully
Jan 25 13:24:25.693984 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c8c2619c-8d76-45c6-af04-607670b98a26 tempest-GroupsTest-1891553318 None] Create group completed successfully.
Jan 25 13:24:28.294268 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:24:28.308132 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:24:28.344887 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:24:28.409729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (bf0de7df-5c42-44c0-98cd-a60c9c72e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:28.422630 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f64e36-3779-4066-b7c9-1a264b5e41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:28.500269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:24:28.585656 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f64e36-3779-4066-b7c9-1a264b5e41d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075323253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e0b722c-f6ae-459a-a522-0dca640f16f3,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=8c5a4715-5f97-4154-81d5-83c07a3b5ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7b6a75f7e4494987391d896b5450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:24:28Z,user_id='66770f26f1ff4aa1be693ddfad97f693',volume_attachment=<?>,volume_type=VolumeType(67aa0c94-50af-4654-9c75-1808bb08c38c),volume_type_id=67aa0c94-50af-4654-9c75-1808bb08c38c)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:28.591384 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df525297-1108-495a-ad0d-c99d286188bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:28.606334 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df525297-1108-495a-ad0d-c99d286188bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:28.622421 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cb02f5-c9f7-4386-940c-7909eea10a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:28.649378 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cb02f5-c9f7-4386-940c-7909eea10a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5a4715-5f97-4154-81d5-83c07a3b5ce9', 'volume_name': 'volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:28.667538 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52034a0f-6c95-4deb-a8ed-5d5842617e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:28.694164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52034a0f-6c95-4deb-a8ed-5d5842617e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:28.694164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67104e5f-3787-4908-b8e4-596e7d49240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:28.934901 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Volume 8c5a4715-5f97-4154-81d5-83c07a3b5ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9', 'volume_size': 1}
Jan 25 13:24:28.934901 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:28.975126 n-d-760454-3 sudo[123940]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:24:28.975906 n-d-760454-3 sudo[123940]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:30.162018 n-d-760454-3 sudo[123940]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:30.165273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.237s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:30.170672 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67104e5f-3787-4908-b8e4-596e7d49240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:30.178566 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e146144e-bf9a-486f-9b79-c6d7111a0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:30.249791 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Volume volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 (8c5a4715-5f97-4154-81d5-83c07a3b5ce9): created successfully
Jan 25 13:24:30.253044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e146144e-bf9a-486f-9b79-c6d7111a0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:30.259324 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (bf0de7df-5c42-44c0-98cd-a60c9c72e042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:30.420822 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-64c1e50c-b6a6-4888-9518-91473cde3aa7 tempest-GroupsTest-1891553318 None] Created volume successfully.
Jan 25 13:24:32.601999 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Skipping remove_export. No iscsi_target is presently exported for volume: 8c5a4715-5f97-4154-81d5-83c07a3b5ce9
Jan 25 13:24:32.638319 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:32.682293 n-d-760454-3 sudo[124002]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9
Jan 25 13:24:32.690218 n-d-760454-3 sudo[124002]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:34.119316 n-d-760454-3 sudo[124002]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:34.123779 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9" returned: 0 in 1.520s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:34.126961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:34.186618 n-d-760454-3 sudo[124029]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9
Jan 25 13:24:34.189161 n-d-760454-3 sudo[124029]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:35.133825 n-d-760454-3 sudo[124029]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:35.137704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9" returned: 0 in 1.010s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:35.140499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:35.251610 n-d-760454-3 sudo[124045]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9
Jan 25 13:24:35.255735 n-d-760454-3 sudo[124045]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:35.966149 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:24:35.967157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:24:35.968914 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:36.042035 n-d-760454-3 sudo[124049]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:24:36.044412 n-d-760454-3 sudo[124049]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:36.691763 n-d-760454-3 sudo[124045]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:36.701624 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8c5a4715-5f97-4154-81d5-83c07a3b5ce9" returned: 0 in 1.554s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:36.701624 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Successfully deleted volume: 8c5a4715-5f97-4154-81d5-83c07a3b5ce9
Jan 25 13:24:36.779149 n-d-760454-3 sudo[124049]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:36.872430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.899s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:36.872430 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:37.018031 n-d-760454-3 sudo[124070]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:24:37.024920 n-d-760454-3 sudo[124070]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:37.297678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Created reservations ['9cf93ec5-9aec-45a7-a8a5-5aa36efe9182'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:24:37.349961 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-935674215 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-935674215, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:24:37.349961 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-935674215 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-935674215, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:24:37.420147 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Created reservations ['5aacd725-c2fd-4f87-8a0d-c8687e079552', '00366457-632e-4332-afc9-1fc0cf7d341a', 'b99eb291-2333-46b0-86e8-4adccc554208', 'bb9e4847-f454-46fb-9dab-a26f49ed174b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:24:37.423374 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:24:37.423374 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:24:37.423374 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:24:38.013499 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:24:38.038951 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:38.071841 n-d-760454-3 sudo[124077]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:24:38.072444 n-d-760454-3 sudo[124077]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:38.460860 n-d-760454-3 sudo[124070]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:38.472464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.594s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:38.472464 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:24:38.580896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Created reservations ['9075c9a5-0e65-4987-9b87-be7ecf570483'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:24:38.640871 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:24:38.640871 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:24:38.640871 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:24:38.782664 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:24:38.782664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:38.853238 n-d-760454-3 sudo[124081]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:24:38.853875 n-d-760454-3 sudo[124081]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:38.963633 n-d-760454-3 sudo[124077]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:38.966011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.955s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:38.968149 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:39.029286 n-d-760454-3 sudo[124083]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:24:39.029852 n-d-760454-3 sudo[124083]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:39.667611 n-d-760454-3 sudo[124081]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:39.669897 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.890s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:39.671188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:39.715558 n-d-760454-3 sudo[124089]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:24:39.723288 n-d-760454-3 sudo[124089]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:40.340045 n-d-760454-3 sudo[124083]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:40.342700 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.374s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:40.343658 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:24:40.369507 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-80093492-b562-45b8-9c24-1317253dcfcf tempest-GroupsTest-1891553318 None] Delete group completed successfully.
Jan 25 13:24:40.684104 n-d-760454-3 sudo[124089]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:40.686382 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.015s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:40.687035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:24:40.691256 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e8c27f1b-97e6-44b3-bf3a-97d041307ece tempest-GroupsTest-1891553318 None] Delete group completed successfully.
Jan 25 13:24:41.190840 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9d2bc91d-7bb9-493a-a10a-c432a3d64182 tempest-GroupsTest-1891553318 None] Group tempest-GroupsTest-Group-1711763610: creating
Jan 25 13:24:41.437583 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9d2bc91d-7bb9-493a-a10a-c432a3d64182 tempest-GroupsTest-1891553318 None] Group tempest-GroupsTest-Group-1711763610: created successfully
Jan 25 13:24:41.505036 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9d2bc91d-7bb9-493a-a10a-c432a3d64182 tempest-GroupsTest-1891553318 None] Create group completed successfully.
Jan 25 13:24:43.777653 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:24:43.784290 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:24:43.784987 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:24:43.812804 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (fd354b02-61b9-4450-b06c-eb8989448b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:43.836230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eec2d29-8394-4c66-b5d9-e4b33b4fc50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:43.947502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:24:44.062639 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eec2d29-8394-4c66-b5d9-e4b33b4fc50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-2045329124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32e91666-e357-4f72-95c1-b7e7a4d1a3ae,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=8971ec99-a6ac-4337-a952-0ac402948794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7b6a75f7e4494987391d896b5450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:24:44Z,user_id='66770f26f1ff4aa1be693ddfad97f693',volume_attachment=<?>,volume_type=VolumeType(079f0e09-6fe5-4019-af8d-bce8fd2bd270),volume_type_id=079f0e09-6fe5-4019-af8d-bce8fd2bd270)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:44.067390 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b211ede-af67-4627-9678-24d254ac0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:44.069922 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b211ede-af67-4627-9678-24d254ac0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:44.074839 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dc975-aeeb-4b94-a936-0cf3a774c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:44.077826 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dc975-aeeb-4b94-a936-0cf3a774c261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8971ec99-a6ac-4337-a952-0ac402948794', 'volume_name': 'volume-8971ec99-a6ac-4337-a952-0ac402948794', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:44.083161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f32fe47-cb3d-4b20-a926-673d64094e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:44.091853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f32fe47-cb3d-4b20-a926-673d64094e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:44.095597 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8369e75e-0ad8-44ed-b4ef-cd9b5a5b0d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:44.151762 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Volume 8971ec99-a6ac-4337-a952-0ac402948794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8971ec99-a6ac-4337-a952-0ac402948794', 'volume_size': 1}
Jan 25 13:24:44.159325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8971ec99-a6ac-4337-a952-0ac402948794 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:44.255813 n-d-760454-3 sudo[124097]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8971ec99-a6ac-4337-a952-0ac402948794 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:24:44.258756 n-d-760454-3 sudo[124097]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:45.618312 n-d-760454-3 sudo[124097]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:45.621413 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8971ec99-a6ac-4337-a952-0ac402948794 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.464s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:45.655392 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8369e75e-0ad8-44ed-b4ef-cd9b5a5b0d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8971ec99-a6ac-4337-a952-0ac402948794', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:45.680099 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0116750-0a58-4fc3-9e94-f7a0701ce40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:45.807128 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Volume volume-8971ec99-a6ac-4337-a952-0ac402948794 (8971ec99-a6ac-4337-a952-0ac402948794): created successfully
Jan 25 13:24:45.807128 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0116750-0a58-4fc3-9e94-f7a0701ce40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:45.807128 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (fd354b02-61b9-4450-b06c-eb8989448b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:45.887717 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-658cc07a-a9b3-40f7-bf96-3adc9de6806c tempest-GroupsTest-1891553318 None] Created volume successfully.
Jan 25 13:24:48.337732 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:24:48.350205 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:24:48.350205 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:24:48.396423 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (2dd9eee0-384a-4de3-bda0-481e79faf360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:48.405683 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd5ba3-186b-4804-9ce9-af8487229b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:48.488983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:24:48.576016 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd5ba3-186b-4804-9ce9-af8487229b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-530253363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32e91666-e357-4f72-95c1-b7e7a4d1a3ae,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b0149251-befb-4b55-90ea-75977551e13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff7b6a75f7e4494987391d896b5450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:24:48Z,user_id='66770f26f1ff4aa1be693ddfad97f693',volume_attachment=<?>,volume_type=VolumeType(079f0e09-6fe5-4019-af8d-bce8fd2bd270),volume_type_id=079f0e09-6fe5-4019-af8d-bce8fd2bd270)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:48.597484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac56e22-d214-46c5-8db4-7b62dd6306d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:48.609214 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac56e22-d214-46c5-8db4-7b62dd6306d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:48.629224 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eceddc-ea93-4a28-898e-4bab1f402f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:48.646590 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eceddc-ea93-4a28-898e-4bab1f402f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0149251-befb-4b55-90ea-75977551e13c', 'volume_name': 'volume-b0149251-befb-4b55-90ea-75977551e13c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:48.658167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221319ae-f3ed-4e18-8ab4-f479629fe886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:48.665252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221319ae-f3ed-4e18-8ab4-f479629fe886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:48.677719 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2200d10d-478e-4110-9c33-4da8d2d275ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:48.739502 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Volume b0149251-befb-4b55-90ea-75977551e13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0149251-befb-4b55-90ea-75977551e13c', 'volume_size': 1}
Jan 25 13:24:48.741792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0149251-befb-4b55-90ea-75977551e13c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:48.790499 n-d-760454-3 sudo[124163]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0149251-befb-4b55-90ea-75977551e13c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:24:48.794744 n-d-760454-3 sudo[124163]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:50.155600 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0149251-befb-4b55-90ea-75977551e13c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.405s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:50.155600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2200d10d-478e-4110-9c33-4da8d2d275ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0149251-befb-4b55-90ea-75977551e13c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:50.155600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb8eca-e3dc-4041-93b9-03f1d4ac7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:24:50.144751 n-d-760454-3 sudo[124163]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:50.242977 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Volume volume-b0149251-befb-4b55-90ea-75977551e13c (b0149251-befb-4b55-90ea-75977551e13c): created successfully
Jan 25 13:24:50.242977 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eb8eca-e3dc-4041-93b9-03f1d4ac7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:24:50.242977 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Flow 'volume_create_manager' (2dd9eee0-384a-4de3-bda0-481e79faf360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:24:50.301811 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5342daca-f377-4607-b065-35731260299e tempest-GroupsTest-1891553318 None] Created volume successfully.
Jan 25 13:24:52.285226 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-733aa796-41c9-4fcc-8ff2-422d83807ab7 tempest-GroupsTest-1891553318 None] Update group completed successfully.
Jan 25 13:24:54.363819 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-62f01f9a-0c79-4c4b-87a3-39912073198b tempest-GroupsTest-1891553318 None] Update group completed successfully.
Jan 25 13:24:55.222006 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Terminate volume connection completed successfully.
Jan 25 13:24:55.410335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:55.609796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.207s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:55.610420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:55.611373 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Removing iscsi_target for Volume ID: c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:24:55.615751 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:56.131175 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af -f" returned: 0 in 0.517s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:56.131813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:56.133648 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:56.352850 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.218s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:56.353879 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:24:56.355738 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22593392-941c-455c-9f39-1fd6cb453f5f tempest-TestVolumeBackupRestore-965971121 None] Remove volume export completed successfully.
Jan 25 13:24:57.216520 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Skipping remove_export. No iscsi_target is presently exported for volume: 8971ec99-a6ac-4337-a952-0ac402948794
Jan 25 13:24:57.221990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:57.308766 n-d-760454-3 sudo[124435]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794
Jan 25 13:24:57.321635 n-d-760454-3 sudo[124435]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:58.848222 n-d-760454-3 sudo[124435]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:58.851991 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794" returned: 0 in 1.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:58.854154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:24:58.943494 n-d-760454-3 sudo[124492]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794
Jan 25 13:24:58.944995 n-d-760454-3 sudo[124492]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:24:59.973812 n-d-760454-3 sudo[124492]: pam_unix(sudo:session): session closed for user root
Jan 25 13:24:59.977822 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794" returned: 0 in 1.123s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:24:59.981985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:00.029935 n-d-760454-3 sudo[124531]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794
Jan 25 13:25:00.030505 n-d-760454-3 sudo[124531]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:01.039894 n-d-760454-3 sudo[124531]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:01.044406 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8971ec99-a6ac-4337-a952-0ac402948794" returned: 0 in 1.062s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:01.053051 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Successfully deleted volume: 8971ec99-a6ac-4337-a952-0ac402948794
Jan 25 13:25:01.054265 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Skipping remove_export. No iscsi_target is presently exported for volume: b0149251-befb-4b55-90ea-75977551e13c
Jan 25 13:25:01.055348 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:01.146571 n-d-760454-3 sudo[124572]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c
Jan 25 13:25:01.147681 n-d-760454-3 sudo[124572]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:02.290381 n-d-760454-3 sudo[124572]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:02.293332 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c" returned: 0 in 1.238s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:02.296046 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:02.326790 n-d-760454-3 sudo[124648]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c
Jan 25 13:25:02.328425 n-d-760454-3 sudo[124648]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:03.075235 n-d-760454-3 sudo[124648]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:03.078522 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c" returned: 0 in 0.782s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:03.080803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:03.160459 n-d-760454-3 sudo[124693]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c
Jan 25 13:25:03.169390 n-d-760454-3 sudo[124693]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:04.354663 n-d-760454-3 sudo[124693]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:04.357399 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0149251-befb-4b55-90ea-75977551e13c" returned: 0 in 1.276s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:04.359153 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Successfully deleted volume: b0149251-befb-4b55-90ea-75977551e13c
Jan 25 13:25:04.757885 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Created reservations ['a3b7ce9c-f4f0-4fea-a45c-1185b0c463a9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:25:04.798845 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-276857360 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-276857360, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:25:04.801040 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-276857360 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-276857360, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:25:04.860316 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Created reservations ['360e3a33-cb16-44f1-953c-c267e3365fed', 'c1f052ab-8de1-4110-a057-3a5ea40f5318', '9e9895cb-967f-4047-93bf-620a8c4489dc', '8a260c15-a441-4afb-9f8e-e592e22476f8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:25:04.862629 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:25:04.862629 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:25:04.862629 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:25:05.244653 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Created reservations ['21ef7701-d096-4983-94d6-e94a3da22c88', '6a820ea4-1b62-43af-8092-3e609e7c1be1', '5f2184f2-aa0e-4e24-9e95-0aaabd49ec6a', '759d49e2-89a0-4a49-828b-639822b7ad8c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:25:05.642807 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:25:05.644489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:05.705582 n-d-760454-3 sudo[124755]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:25:05.706369 n-d-760454-3 sudo[124755]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:06.466413 n-d-760454-3 sudo[124755]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:06.469376 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.824s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:06.472223 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:06.554768 n-d-760454-3 sudo[124763]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:25:06.557797 n-d-760454-3 sudo[124763]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:07.819136 n-d-760454-3 sudo[124763]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:07.822612 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.349s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:07.825304 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:25:07.835455 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0a08e2fa-5f40-4539-8cee-bab7c6417d1a tempest-GroupsTest-1891553318 None] Delete group completed successfully.
Jan 25 13:25:15.001493 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:15.049930 n-d-760454-3 sudo[124913]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:15.050521 n-d-760454-3 sudo[124913]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:15.767281 n-d-760454-3 sudo[124913]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:15.770043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 0.770s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:15.882779 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:15.906041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.025s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:15.906418 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:15.907510 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:25:15.908469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Creating iscsi_target for Volume ID: volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Created volume path /opt/stack/data/cinder/volumes/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af,
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af>
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:     incominguser DwGNjSHubhXZB8oNESu7 X2sGqSH2RDXZ9SiV
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:25:15.996363 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:25:15.998040 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:16.640010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 0.642s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:16.640728 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:16.642079 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:25:16.642817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:25:16.646864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:16.664011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:16.665454 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:16.666304 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:25:16.668009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:16.843324 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.175s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:16.844004 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:16.847553 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:16.993903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.147s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:16.994724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:16.996137 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:25:17.352203 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-5223984b-a665-45f6-9f1a-11310c34ea9b req-7e8a253f-573a-46a7-a82d-d0ecae15e5e7 tempest-TestVolumeBackupRestore-965971121 None] attachment_update completed successfully.
Jan 25 13:25:29.065027 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:25:29.070257 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:25:29.071664 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:25:29.104481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Flow 'volume_create_manager' (bb8eb105-6185-48c0-a8c0-02f81a447195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:25:29.115837 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413f9fd7-5cb2-4c7a-8eb4-bfbd086da75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:29.142789 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:25:29.172523 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413f9fd7-5cb2-4c7a-8eb4-bfbd086da75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-531234105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c03ee44b-44fe-4f11-b227-48e2f51cba50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7c96e308284d78a8cdda68c5478b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:25:29Z,user_id='864dfd44e7f14b90bb030cb6be284071',volume_attachment=<?>,volume_type=VolumeType(25b671fb-2e94-403e-9499-3a04228eed94),volume_type_id=25b671fb-2e94-403e-9499-3a04228eed94)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:29.176103 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482729d4-a266-4855-9f9f-eadab0276bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:29.178696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482729d4-a266-4855-9f9f-eadab0276bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:29.181995 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3824670b-3840-4012-aacb-35ff2fe10a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:29.184899 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3824670b-3840-4012-aacb-35ff2fe10a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03ee44b-44fe-4f11-b227-48e2f51cba50', 'volume_name': 'volume-c03ee44b-44fe-4f11-b227-48e2f51cba50', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:29.187660 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de76223-e3dc-4781-b4a9-d047c8087eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:29.190166 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de76223-e3dc-4781-b4a9-d047c8087eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:29.192885 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227bb109-e8a0-4bc3-9e86-8db1ce9dd634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:29.193921 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Volume c03ee44b-44fe-4f11-b227-48e2f51cba50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03ee44b-44fe-4f11-b227-48e2f51cba50', 'volume_size': 1}
Jan 25 13:25:29.196253 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:29.235554 n-d-760454-3 sudo[125046]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:25:29.237061 n-d-760454-3 sudo[125046]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:30.155443 n-d-760454-3 sudo[125046]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:30.157871 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.962s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:30.162438 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227bb109-e8a0-4bc3-9e86-8db1ce9dd634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03ee44b-44fe-4f11-b227-48e2f51cba50', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:30.165916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50606e11-1935-48bb-8484-9da0174ac326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:30.231160 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Volume volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 (c03ee44b-44fe-4f11-b227-48e2f51cba50): created successfully
Jan 25 13:25:30.233523 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50606e11-1935-48bb-8484-9da0174ac326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:30.237069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Flow 'volume_create_manager' (bb8eb105-6185-48c0-a8c0-02f81a447195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:25:30.283207 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ea7a0ac8-e50c-4af8-adbc-9f32f1112abc tempest-VolumeTypesTest-1566032818 None] Created volume successfully.
Jan 25 13:25:31.194995 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:25:31.196442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:31.250190 n-d-760454-3 sudo[125156]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:25:31.250773 n-d-760454-3 sudo[125156]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:32.078477 n-d-760454-3 sudo[125156]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:32.082002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.886s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:32.083400 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:32.109849 n-d-760454-3 sudo[125209]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:25:32.111516 n-d-760454-3 sudo[125209]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:32.782078 n-d-760454-3 sudo[125209]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:32.784362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:32.786290 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:25:32.797942 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-aa227299-8782-4929-8037-bc185c554754 tempest-VolumeTypesTest-1566032818 None] Retype volume completed successfully.
Jan 25 13:25:34.902538 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Lock "b'cinder-c03ee44b-44fe-4f11-b227-48e2f51cba50-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:25:35.044697 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Skipping remove_export. No iscsi_target is presently exported for volume: c03ee44b-44fe-4f11-b227-48e2f51cba50
Jan 25 13:25:35.045598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:35.064623 n-d-760454-3 sudo[125253]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50
Jan 25 13:25:35.065704 n-d-760454-3 sudo[125253]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:35.830881 n-d-760454-3 sudo[125253]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:35.835174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50" returned: 0 in 0.788s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:35.837566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:35.864221 n-d-760454-3 sudo[125280]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50
Jan 25 13:25:35.865545 n-d-760454-3 sudo[125280]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:35.966346 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:25:35.966919 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:25:35.968051 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:36.006318 n-d-760454-3 sudo[125286]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:25:36.007392 n-d-760454-3 sudo[125286]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:36.394802 n-d-760454-3 sudo[125280]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:36.397498 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50" returned: 0 in 0.560s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:36.400586 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:36.420715 n-d-760454-3 sudo[125297]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50
Jan 25 13:25:36.421821 n-d-760454-3 sudo[125297]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:36.579639 n-d-760454-3 sudo[125286]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:36.582244 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:36.583650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:36.605678 n-d-760454-3 sudo[125301]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:25:36.607137 n-d-760454-3 sudo[125301]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:37.143392 n-d-760454-3 sudo[125301]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:37.145964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.562s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:37.149385 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:25:37.182262 n-d-760454-3 sudo[125297]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:37.184377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c03ee44b-44fe-4f11-b227-48e2f51cba50" returned: 0 in 0.784s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:37.186464 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Successfully deleted volume: c03ee44b-44fe-4f11-b227-48e2f51cba50
Jan 25 13:25:37.221416 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1632167643 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1632167643, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:25:37.222572 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1632167643 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1632167643, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:25:37.274619 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Created reservations ['1c8cef81-0a0a-4740-a8ae-74b9cf25eb83', '4f9458f1-e7a1-439b-9bf5-325e7a692c03', '7acec69c-2094-4e95-b5a7-cad8422c33a1', '23f67b22-2fa1-4e02-b521-2aa31d8656c2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:25:37.277124 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:25:37.277124 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:25:37.277124 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:25:37.407771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:25:37.408584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:37.449821 n-d-760454-3 sudo[125312]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:25:37.450592 n-d-760454-3 sudo[125312]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:38.052909 n-d-760454-3 sudo[125312]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:38.055651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:38.057677 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:38.082491 n-d-760454-3 sudo[125316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:25:38.083052 n-d-760454-3 sudo[125316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:38.715819 n-d-760454-3 sudo[125316]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:38.718530 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:38.721379 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:25:38.730419 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Deleted volume successfully.
Jan 25 13:25:38.811659 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-23b0cf04-824e-43f5-a224-613e56e95c89 tempest-VolumeTypesTest-1566032818 None] Lock "b'cinder-c03ee44b-44fe-4f11-b227-48e2f51cba50-delete_volume'" released by "delete_volume" :: held 3.909s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:25:48.002797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:25:48.008631 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:25:48.010164 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:25:48.028224 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (321776ba-1d71-4015-b1f6-f26322d1e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:25:48.033038 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc1d37-f81f-4203-82e8-30c68db15210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:48.076603 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:25:48.112222 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fc1d37-f81f-4203-82e8-30c68db15210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1216053468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=4de584c6-296c-4731-a230-55cc1a91159e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75e302167b7457d8fc0b90bb2c1fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:25:48Z,user_id='409c749d9e3b45f5b4682f41c1f65d14',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:48.117242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9662cb-442e-4d63-a8f6-255b31459cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:48.120620 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9662cb-442e-4d63-a8f6-255b31459cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:48.127321 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6de6a4-2530-402d-b21b-23d6d99dab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:48.130406 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6de6a4-2530-402d-b21b-23d6d99dab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de584c6-296c-4731-a230-55cc1a91159e', 'volume_name': 'volume-4de584c6-296c-4731-a230-55cc1a91159e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:48.134269 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d7fb1f-4382-404d-91d9-daf69c8b6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:48.136764 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d7fb1f-4382-404d-91d9-daf69c8b6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:48.139402 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7151ea-1fcf-42e8-a996-4f9ca163b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:48.140416 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Volume 4de584c6-296c-4731-a230-55cc1a91159e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de584c6-296c-4731-a230-55cc1a91159e', 'volume_size': 1}
Jan 25 13:25:48.142588 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4de584c6-296c-4731-a230-55cc1a91159e stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:48.162569 n-d-760454-3 sudo[125386]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4de584c6-296c-4731-a230-55cc1a91159e stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:25:48.164061 n-d-760454-3 sudo[125386]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:49.089505 n-d-760454-3 sudo[125386]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:49.091743 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4de584c6-296c-4731-a230-55cc1a91159e stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.949s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:49.095843 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7151ea-1fcf-42e8-a996-4f9ca163b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de584c6-296c-4731-a230-55cc1a91159e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:49.098614 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0707ec9d-45b5-4b5b-8762-f0b2e51fc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:25:49.193940 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Volume volume-4de584c6-296c-4731-a230-55cc1a91159e (4de584c6-296c-4731-a230-55cc1a91159e): created successfully
Jan 25 13:25:49.197599 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0707ec9d-45b5-4b5b-8762-f0b2e51fc945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:25:49.205551 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (321776ba-1d71-4015-b1f6-f26322d1e89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:25:49.256823 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ac667947-1e00-4af3-9ead-d6ca57c69b08 tempest-VolumesBackupsAdminTest-1175234813 None] Created volume successfully.
Jan 25 13:25:50.941127 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Creating a new backup for volume volume-4de584c6-296c-4731-a230-55cc1a91159e. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:25:50.961519 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:50.986191 n-d-760454-3 sudo[125477]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:25:50.986751 n-d-760454-3 sudo[125477]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:25:51.465789 n-d-760454-3 sudo[125477]: pam_unix(sudo:session): session closed for user root
Jan 25 13:25:51.468265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e" returned: 0 in 0.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:51.572517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:51.579391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:51.579749 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:25:51.580437 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:25:51.582916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Creating iscsi_target for Volume ID: volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Created volume path /opt/stack/data/cinder/volumes/volume-4de584c6-296c-4731-a230-55cc1a91159e,
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e>
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:     incominguser uLRRNPqwHN3zBv2VECXV Hf4RBrb2RjFp9sNj
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:25:51.678738 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:25:51.683144 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:52.365800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e" returned: 0 in 0.684s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:52.367616 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:52.368486 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:25:52.369071 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:25:52.373093 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:52.390341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:52.390818 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e\n            Backing store flags: \n    Account information:\n        uLRRNPqwHN3zBv2VECXV\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:25:52.391545 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:25:52.394602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:52.553296 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.160s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:52.553633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e\n            Backing store flags: \n    Account information:\n        uLRRNPqwHN3zBv2VECXV\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:52.555679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:25:52.695794 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.140s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:25:52.696280 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354256]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e\n            Backing store flags: \n    Account information:\n        uLRRNPqwHN3zBv2VECXV\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:25:52.698276 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:25:52.812040 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Initialize volume connection completed successfully.
Jan 25 13:26:35.964002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:26:35.964689 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:26:35.965876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:26:35.987356 n-d-760454-3 sudo[125949]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:26:35.987903 n-d-760454-3 sudo[125949]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:26:36.713359 n-d-760454-3 sudo[125949]: pam_unix(sudo:session): session closed for user root
Jan 25 13:26:36.716360 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.750s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:26:36.717878 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:26:36.739430 n-d-760454-3 sudo[125969]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:26:36.741515 n-d-760454-3 sudo[125969]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:26:37.858337 n-d-760454-3 sudo[125969]: pam_unix(sudo:session): session closed for user root
Jan 25 13:26:37.868854 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.150s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:26:37.872842 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:27:05.677781 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Terminate volume connection completed successfully.
Jan 25 13:27:05.827883 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:06.047857 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.220s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:06.048915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e\n            Backing store flags: \n    Account information:\n        uLRRNPqwHN3zBv2VECXV\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:06.049761 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Removing iscsi_target for Volume ID: 4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:27:06.052768 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:06.369966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-4de584c6-296c-4731-a230-55cc1a91159e -f" returned: 0 in 0.318s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:06.370692 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:06.375478 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:06.493505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:06.496449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:06.497391 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-014dc140-8b30-477d-ac08-7bf97f1b0c72 tempest-VolumesBackupsAdminTest-1175234813 None] Remove volume export completed successfully.
Jan 25 13:27:08.543721 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fb278341-468a-4d8f-ac53-13cc1ca3330a tempest-GroupsV314Test-253344037 None] Group tempest-GroupsV314Test-Group-834306686: creating
Jan 25 13:27:08.841105 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fb278341-468a-4d8f-ac53-13cc1ca3330a tempest-GroupsV314Test-253344037 None] Group tempest-GroupsV314Test-Group-834306686: created successfully
Jan 25 13:27:08.862124 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fb278341-468a-4d8f-ac53-13cc1ca3330a tempest-GroupsV314Test-253344037 None] Create group completed successfully.
Jan 25 13:27:11.545371 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:27:11.552248 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:27:11.553071 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:27:11.581620 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Flow 'volume_create_manager' (8eb14cb0-4886-4c32-89ed-96f8f9a56964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:27:11.609360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20adee77-7d88-44fe-a360-509efe04b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:11.692697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:27:11.789061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20adee77-7d88-44fe-a360-509efe04b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-223257278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1cbd020b-549f-4aed-b55b-a465bca81eb4,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=ea99263f-b714-4858-b7de-7a4f844603a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cefa52fad07d4abfbb917bd5150070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:27:11Z,user_id='5eed1654301247879c15d73c8eb38a59',volume_attachment=<?>,volume_type=VolumeType(53c455e6-05ad-4749-9107-645479389bde),volume_type_id=53c455e6-05ad-4749-9107-645479389bde)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:11.802810 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7a7292-92e7-46fb-b21d-772772c57195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:11.808596 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7a7292-92e7-46fb-b21d-772772c57195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:11.814664 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24432cc-86df-4683-8ca6-76ca64383ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:11.819979 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24432cc-86df-4683-8ca6-76ca64383ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea99263f-b714-4858-b7de-7a4f844603a3', 'volume_name': 'volume-ea99263f-b714-4858-b7de-7a4f844603a3', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:11.841366 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3744c51f-9b42-45c6-897a-8fbc627a4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:11.845401 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3744c51f-9b42-45c6-897a-8fbc627a4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:11.848815 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875cf15a-c5ce-48ef-9ae2-05671710befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:11.966278 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:27:11.978077 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:27:11.978683 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:27:12.023198 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (10126ee5-5aa3-490e-a47e-bca63ee2f4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:27:12.037762 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280cae4d-64ea-405d-99de-7c2ddef81c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:12.114807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:27:12.145032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280cae4d-64ea-405d-99de-7c2ddef81c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:27:10Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e9db0dd7-a688-4490-b605-1eaa08aea461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=0b0a02d6-6cff-42f3-816e-0840f702ed4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75e302167b7457d8fc0b90bb2c1fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:27:12Z,user_id='409c749d9e3b45f5b4682f41c1f65d14',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:12.147902 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c01e13-b790-463c-a0b6-b8c75c0adb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:12.150759 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c01e13-b790-463c-a0b6-b8c75c0adb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:12.154703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c3cde8-522e-4dd8-8214-8d4baca96702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:12.157759 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c3cde8-522e-4dd8-8214-8d4baca96702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0a02d6-6cff-42f3-816e-0840f702ed4a', 'volume_name': 'volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:12.160737 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b48eec-d3ba-48b3-b03d-86fde402bba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:12.162958 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b48eec-d3ba-48b3-b03d-86fde402bba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:12.165689 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02222898-2e49-4b4b-b93a-24c64c05859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:12.166546 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Volume 0b0a02d6-6cff-42f3-816e-0840f702ed4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a', 'volume_size': 1}
Jan 25 13:27:12.167660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:12.190734 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Volume ea99263f-b714-4858-b7de-7a4f844603a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea99263f-b714-4858-b7de-7a4f844603a3', 'volume_size': 1}
Jan 25 13:27:12.191879 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea99263f-b714-4858-b7de-7a4f844603a3 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:12.192678 n-d-760454-3 sudo[126308]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:27:12.193227 n-d-760454-3 sudo[126308]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:12.212225 n-d-760454-3 sudo[126310]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea99263f-b714-4858-b7de-7a4f844603a3 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:27:12.212782 n-d-760454-3 sudo[126310]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:13.373086 n-d-760454-3 sudo[126308]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:13.376763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.208s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:13.388838 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02222898-2e49-4b4b-b93a-24c64c05859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:13.397429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2791901f-1e5d-4311-82db-06324f816c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:13.549962 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Volume volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a (0b0a02d6-6cff-42f3-816e-0840f702ed4a): created successfully
Jan 25 13:27:13.555039 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2791901f-1e5d-4311-82db-06324f816c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:13.573165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (10126ee5-5aa3-490e-a47e-bca63ee2f4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:27:13.707429 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Created volume successfully.
Jan 25 13:27:13.756287 n-d-760454-3 sudo[126310]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:13.758633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ea99263f-b714-4858-b7de-7a4f844603a3 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.566s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:13.764033 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875cf15a-c5ce-48ef-9ae2-05671710befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea99263f-b714-4858-b7de-7a4f844603a3', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:13.770023 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc9898e-836f-4781-bddd-8a8b76782ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:27:13.927070 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Volume volume-ea99263f-b714-4858-b7de-7a4f844603a3 (ea99263f-b714-4858-b7de-7a4f844603a3): created successfully
Jan 25 13:27:13.929832 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc9898e-836f-4781-bddd-8a8b76782ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:27:13.933419 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Flow 'volume_create_manager' (8eb14cb0-4886-4c32-89ed-96f8f9a56964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:27:14.190187 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9090c227-8f27-4521-b309-b6f0a3d7f4f6 tempest-GroupsV314Test-253344037 None] Created volume successfully.
Jan 25 13:27:14.947863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:14.997704 n-d-760454-3 sudo[126408]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:27:14.998304 n-d-760454-3 sudo[126408]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:15.804334 n-d-760454-3 sudo[126408]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:15.807344 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a" returned: 0 in 0.859s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:15.958971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:15.971411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:15.971765 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:27:15.986600 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:27:15.989562 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Creating iscsi_target for Volume ID: volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Created volume path /opt/stack/data/cinder/volumes/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a,
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a>
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:     incominguser uAJHKGRHSuYMKGNKr99L nXuh7xJvCWkx2iZE
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:27:16.148483 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:27:16.195224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:16.271066 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Creating clone of volume: ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:27:16.272153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:16.343372 n-d-760454-3 sudo[126437]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:27:16.349357 n-d-760454-3 sudo[126437]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:16.978609 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a" returned: 0 in 0.823s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:16.979544 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:16.980596 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:27:16.981301 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:27:16.983386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:17.011596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.026s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:17.012153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n            Backing store flags: \n    Account information:\n        uAJHKGRHSuYMKGNKr99L\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:27:17.013123 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:27:17.020803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:17.188682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.169s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:17.188870 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n            Backing store flags: \n    Account information:\n        uAJHKGRHSuYMKGNKr99L\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:17.192824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:17.378957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.188s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:17.379677 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n            Backing store flags: \n    Account information:\n        uAJHKGRHSuYMKGNKr99L\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:27:17.390831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:27:17.535594 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Initialize volume connection completed successfully.
Jan 25 13:27:17.666422 n-d-760454-3 sudo[126437]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:17.668804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3" returned: 0 in 1.396s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:17.669874 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc --snapshot stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:17.716170 n-d-760454-3 sudo[126498]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc --snapshot stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 -L 1.00g
Jan 25 13:27:17.716923 n-d-760454-3 sudo[126498]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:19.539823 n-d-760454-3 sudo[126498]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:19.549318 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc --snapshot stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 -L 1.00g" returned: 0 in 1.874s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:19.549318 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-72f6713e-7397-4eb6-b90c-08203b9408cc stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:19.570464 n-d-760454-3 sudo[126682]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-72f6713e-7397-4eb6-b90c-08203b9408cc stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:27:19.571573 n-d-760454-3 sudo[126682]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:20.630483 n-d-760454-3 sudo[126682]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:20.637730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-72f6713e-7397-4eb6-b90c-08203b9408cc stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.086s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:20.637730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:20.660463 n-d-760454-3 sudo[126717]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:27:20.661359 n-d-760454-3 sudo[126717]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:21.713881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 0.692s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:21.713881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:21.325766 n-d-760454-3 sudo[126717]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:21.349931 n-d-760454-3 sudo[126723]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc iflag=direct
Jan 25 13:27:21.350470 n-d-760454-3 sudo[126723]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:22.058228 n-d-760454-3 sudo[126723]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:22.062986 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc iflag=direct" returned: 0 in 0.730s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:22.062986 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:22.123704 n-d-760454-3 sudo[126733]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc oflag=direct
Jan 25 13:27:22.124661 n-d-760454-3 sudo[126733]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:23.391608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc oflag=direct" returned: 0 in 1.326s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:23.391608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:23.375977 n-d-760454-3 sudo[126733]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:23.484932 n-d-760454-3 sudo[126743]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:27:23.493716 n-d-760454-3 sudo[126743]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:35.981559 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:27:35.981559 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:27:35.981559 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:36.028481 n-d-760454-3 sudo[126859]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:27:36.029309 n-d-760454-3 sudo[126859]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:37.481853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.499s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:37.481853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:37.470828 n-d-760454-3 sudo[126859]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:37.526805 n-d-760454-3 sudo[126863]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:27:37.528288 n-d-760454-3 sudo[126863]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:39.434413 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.952s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:39.434413 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:27:39.422800 n-d-760454-3 sudo[126863]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:55.238173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc of=/dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 31.843s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:55.238173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-clone--snap--72f6713e--7397--4eb6--b90c--08203b9408cc, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--72f6713e--7397--4eb6--b90c--08203b9408cc, size 1024.00 MB, duration 31.84 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:27:55.238173 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Volume copy 1024.00 MB at 32.16 MB/s
Jan 25 13:27:55.238173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:55.321646 n-d-760454-3 sudo[127047]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:27:55.322731 n-d-760454-3 sudo[127047]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:56.809904 n-d-760454-3 sudo[127047]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:56.814716 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 1.576s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:27:56.818736 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:27:56.921743 n-d-760454-3 sudo[127067]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:27:56.922267 n-d-760454-3 sudo[127067]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:27:59.805197 n-d-760454-3 sudo[127067]: pam_unix(sudo:session): session closed for user root
Jan 25 13:27:59.815866 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 2.993s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:00.411107 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cd3d917b-30c8-46ea-88d3-7ad03d55f60a tempest-GroupsV314Test-253344037 None] Create group from source-group-1cbd020b-549f-4aed-b55b-a465bca81eb4 completed successfully.
Jan 25 13:28:02.650942 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Skipping remove_export. No iscsi_target is presently exported for volume: 72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:28:02.658001 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:02.731489 n-d-760454-3 sudo[127135]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:28:02.732075 n-d-760454-3 sudo[127135]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:03.846712 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:28:03.846712 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:28:03.846712 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:28:03.919467 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Flow 'volume_create_manager' (f83e3228-a8d6-42fc-9f3b-dcf1feb13925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:03.942411 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e9605f-a45d-4eea-9889-35bf242fcbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:04.011186 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:28:04.122682 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e9605f-a45d-4eea-9889-35bf242fcbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-631408571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=30fdbb95-4e11-4565-b643-6f086e3f56e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fc384ccaf140ec97f0dcab65cf848e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:28:04Z,user_id='0b33d968ebc14d39802128201109a228',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:04.122682 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f9a5c3-547a-4d76-9d8e-79bf159cf0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:04.145289 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f9a5c3-547a-4d76-9d8e-79bf159cf0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:04.154366 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca815f68-7765-492d-803d-caf53753bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:04.150995 n-d-760454-3 sudo[127135]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca815f68-7765-492d-803d-caf53753bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fdbb95-4e11-4565-b643-6f086e3f56e5', 'volume_name': 'volume-30fdbb95-4e11-4565-b643-6f086e3f56e5', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55169898-5f82-49f5-b855-d6652285c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55169898-5f82-49f5-b855-d6652285c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459d1e6f-02f7-4947-8f01-218069be99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume 30fdbb95-4e11-4565-b643-6f086e3f56e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fdbb95-4e11-4565-b643-6f086e3f56e5', 'volume_size': 1}
Jan 25 13:28:04.184341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:04.214059 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 1.562s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:04.215429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:04.245322 n-d-760454-3 sudo[127162]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:28:04.245894 n-d-760454-3 sudo[127162]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:04.275036 n-d-760454-3 sudo[127164]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:28:04.275788 n-d-760454-3 sudo[127164]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:05.146030 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 0.920s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:05.146030 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:05.133781 n-d-760454-3 sudo[127164]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:05.164837 n-d-760454-3 sudo[127188]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:28:05.165459 n-d-760454-3 sudo[127188]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:05.862771 n-d-760454-3 sudo[127162]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:05.865534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.682s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:05.911010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459d1e6f-02f7-4947-8f01-218069be99fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fdbb95-4e11-4565-b643-6f086e3f56e5', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:05.911010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84ead16-0543-47b4-bc04-d05865a8d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:05.965282 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 (30fdbb95-4e11-4565-b643-6f086e3f56e5): created successfully
Jan 25 13:28:05.967906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84ead16-0543-47b4-bc04-d05865a8d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:05.971791 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Flow 'volume_create_manager' (f83e3228-a8d6-42fc-9f3b-dcf1feb13925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:06.073780 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-36974a43-a17a-4e1b-bed4-407a6fb1fadc tempest-VolumeQuotasAdminTestJSON-782648832 None] Created volume successfully.
Jan 25 13:28:06.160924 n-d-760454-3 sudo[127188]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:06.163775 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-72f6713e-7397-4eb6-b90c-08203b9408cc" returned: 0 in 1.025s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:06.166420 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Successfully deleted volume: 72f6713e-7397-4eb6-b90c-08203b9408cc
Jan 25 13:28:06.496191 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Created reservations ['79fb1e73-8772-491b-8418-4b1124eb03b6'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:06.529883 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1396107430 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1396107430, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:28:06.531306 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1396107430 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1396107430, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:28:06.668703 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Terminate volume connection completed successfully.
Jan 25 13:28:06.679601 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Created reservations ['d686c100-eb46-470a-ade5-ac910865e72b', '9dca2e69-680c-4645-bc2c-c6d6beb4bf89', 'd14c6689-30f7-4269-9eed-6df06c48a807', '12afd7f4-37b2-463b-98c1-43e5b58d2656'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:06.683552 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:06.683552 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:06.683552 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:06.794651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:06.934716 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Lock "b'cinder-30fdbb95-4e11-4565-b643-6f086e3f56e5-delete_volume'" acquired by "delete_volume" :: waited 0.158s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:06.965090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.150s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:06.965090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a\n            Backing store flags: \n    Account information:\n        uAJHKGRHSuYMKGNKr99L\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:06.965090 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Removing iscsi_target for Volume ID: 0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:06.978719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:07.384008 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Skipping remove_export. No iscsi_target is presently exported for volume: 30fdbb95-4e11-4565-b643-6f086e3f56e5
Jan 25 13:28:07.385855 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:07.419554 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a -f" returned: 0 in 0.440s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:07.419554 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:07.420846 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:07.429682 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:07.429682 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:07.429682 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:07.453147 n-d-760454-3 sudo[127254]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5
Jan 25 13:28:07.454393 n-d-760454-3 sudo[127254]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:07.537617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:07.538681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:07.555682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.125s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:07.556123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:07.558335 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-48589647-cd9d-4961-a9fa-383ec5a64083 tempest-VolumesBackupsAdminTest-1175234813 None] Remove volume export completed successfully.
Jan 25 13:28:07.566395 n-d-760454-3 sudo[127263]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:07.567594 n-d-760454-3 sudo[127263]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:08.025400 n-d-760454-3 sudo[127263]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:08.027265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:08.029048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:08.049448 n-d-760454-3 sudo[127269]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:08.049997 n-d-760454-3 sudo[127269]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:08.329891 n-d-760454-3 sudo[127254]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:08.343012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5" returned: 0 in 0.946s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:08.343012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:08.362738 n-d-760454-3 sudo[127271]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5
Jan 25 13:28:08.363282 n-d-760454-3 sudo[127271]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:08.968972 n-d-760454-3 sudo[127271]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:08.971534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5" returned: 0 in 0.637s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:08.973508 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:09.009010 n-d-760454-3 sudo[127277]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5
Jan 25 13:28:09.009569 n-d-760454-3 sudo[127277]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:09.048746 n-d-760454-3 sudo[127269]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:09.113292 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.084s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:09.147365 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:09.210656 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-028b4bec-1635-42ba-9985-1abd4d33b554 tempest-GroupsV314Test-253344037 None] Delete group completed successfully.
Jan 25 13:28:09.226430 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-0b0a02d6-6cff-42f3-816e-0840f702ed4a-delete_volume'" acquired by "delete_volume" :: waited 0.094s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:09.252252 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Skipping remove_export. No iscsi_target is presently exported for volume: ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:28:09.266329 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:09.311349 n-d-760454-3 sudo[127281]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:28:09.312452 n-d-760454-3 sudo[127281]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:09.601307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:09.805221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.212s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:09.805672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357144]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:09.806879 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Skipping remove_export. No iscsi_target is presently exported for volume: 0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:09.808340 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:09.855613 n-d-760454-3 sudo[127290]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:09.856964 n-d-760454-3 sudo[127290]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:10.139867 n-d-760454-3 sudo[127277]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:10.142638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-30fdbb95-4e11-4565-b643-6f086e3f56e5" returned: 0 in 1.169s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:10.144133 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Successfully deleted volume: 30fdbb95-4e11-4565-b643-6f086e3f56e5
Jan 25 13:28:10.291314 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Created reservations ['81d8a28c-0290-4cdb-bc92-26729c233df9', '1e3d6305-bdf8-4e0d-b9e3-6f495826971d', 'd0ea2bc6-b9b6-4ef2-853f-72aba6a39f5e', '80f509ee-52db-4d9a-9e6c-d45019a9e416'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:10.297175 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:10.297175 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:10.297175 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:10.434400 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:10.448011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:10.499004 n-d-760454-3 sudo[127296]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:10.499604 n-d-760454-3 sudo[127296]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:10.781913 n-d-760454-3 sudo[127281]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:10.785920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3" returned: 0 in 1.518s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:10.787228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:10.882379 n-d-760454-3 sudo[127300]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:28:10.886943 n-d-760454-3 sudo[127300]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:10.904934 n-d-760454-3 sudo[127290]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:10.910332 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a" returned: 0 in 1.101s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:10.912916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:10.962169 n-d-760454-3 sudo[127302]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:10.962931 n-d-760454-3 sudo[127302]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:11.202260 n-d-760454-3 sudo[127296]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:11.205653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:11.209669 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:11.268930 n-d-760454-3 sudo[127306]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:11.271292 n-d-760454-3 sudo[127306]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:11.808951 n-d-760454-3 sudo[127302]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:11.812112 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a" returned: 0 in 0.899s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:11.815642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:11.858691 n-d-760454-3 sudo[127310]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:11.859821 n-d-760454-3 sudo[127310]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:12.245313 n-d-760454-3 sudo[127300]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:12.247551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3" returned: 0 in 1.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:12.249826 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:12.296720 n-d-760454-3 sudo[127314]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:28:12.305298 n-d-760454-3 sudo[127314]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:12.867973 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:28:12.874400 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:28:12.874400 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:28:12.938307 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (4a361a97-461f-4014-baa1-7d71bc084fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:12.939315 n-d-760454-3 sudo[127306]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:12.958806 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fd9441-4161-4a0b-bb6b-3dac1011b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.003159 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:28:13.100976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.872s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:13.103775 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:13.113063 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Deleted volume successfully.
Jan 25 13:28:13.130828 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fd9441-4161-4a0b-bb6b-3dac1011b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1304197755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=3d701d75-ed87-4d96-ba1b-63f33781b018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75e302167b7457d8fc0b90bb2c1fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:28:13Z,user_id='409c749d9e3b45f5b4682f41c1f65d14',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.141719 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec4ddb-20a1-4d3d-9f50-3f4b31e22017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.141719 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec4ddb-20a1-4d3d-9f50-3f4b31e22017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.147623 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e4d6db-7a5a-41d5-94f4-8ae8df852d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.152595 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e4d6db-7a5a-41d5-94f4-8ae8df852d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d701d75-ed87-4d96-ba1b-63f33781b018', 'volume_name': 'volume-3d701d75-ed87-4d96-ba1b-63f33781b018', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.156600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5add29f8-7be2-47f9-847e-829175e8eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.166477 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5add29f8-7be2-47f9-847e-829175e8eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.170409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46ac574-cfd5-4883-bcc2-1de7a4d66953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.171322 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Volume 3d701d75-ed87-4d96-ba1b-63f33781b018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d701d75-ed87-4d96-ba1b-63f33781b018', 'volume_size': 1}
Jan 25 13:28:13.172590 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3d701d75-ed87-4d96-ba1b-63f33781b018 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:13.223361 n-d-760454-3 sudo[127323]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3d701d75-ed87-4d96-ba1b-63f33781b018 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:28:13.223969 n-d-760454-3 sudo[127323]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:13.327990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b26f1cfb-ed32-47dc-b0f7-a64b5d050971 tempest-VolumeQuotasAdminTestJSON-782648832 None] Lock "b'cinder-30fdbb95-4e11-4565-b643-6f086e3f56e5-delete_volume'" released by "delete_volume" :: held 6.403s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:13.360693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:28:13.370028 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:28:13.371374 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:28:13.386672 n-d-760454-3 sudo[127310]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:13.451809 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Flow 'volume_create_manager' (40aa46dc-c582-4ff7-b306-3e5ef13aacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:13.463469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a8ca4f-7e2d-4259-af97-e1bead7f23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.548690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0b0a02d6-6cff-42f3-816e-0840f702ed4a" returned: 0 in 1.732s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:13.552586 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Successfully deleted volume: 0b0a02d6-6cff-42f3-816e-0840f702ed4a
Jan 25 13:28:13.572987 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:28:13.685062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a8ca4f-7e2d-4259-af97-e1bead7f23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-95789399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=9510ed96-be40-491c-ab22-0d5a7e59f589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fc384ccaf140ec97f0dcab65cf848e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:28:13Z,user_id='0b33d968ebc14d39802128201109a228',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.702326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043fe913-86e6-4dae-b0f3-e4779394016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.705706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043fe913-86e6-4dae-b0f3-e4779394016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.721915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f17424-9d7c-437e-8453-9ec023ae60da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.729828 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f17424-9d7c-437e-8453-9ec023ae60da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9510ed96-be40-491c-ab22-0d5a7e59f589', 'volume_name': 'volume-9510ed96-be40-491c-ab22-0d5a7e59f589', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.732973 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f65ae-625e-43c4-8e8e-9f1fa7cd53cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.743338 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f65ae-625e-43c4-8e8e-9f1fa7cd53cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:13.747213 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755449ae-81ee-40f9-abd8-31caffc0d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:13.752513 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume 9510ed96-be40-491c-ab22-0d5a7e59f589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9510ed96-be40-491c-ab22-0d5a7e59f589', 'volume_size': 1}
Jan 25 13:28:13.754957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9510ed96-be40-491c-ab22-0d5a7e59f589 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:13.774119 n-d-760454-3 sudo[127314]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:13.811203 n-d-760454-3 sudo[127335]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9510ed96-be40-491c-ab22-0d5a7e59f589 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:28:13.812110 n-d-760454-3 sudo[127335]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:13.824620 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ea99263f-b714-4858-b7de-7a4f844603a3" returned: 0 in 1.574s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:13.826235 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Successfully deleted volume: ea99263f-b714-4858-b7de-7a4f844603a3
Jan 25 13:28:14.093948 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Created reservations ['3fecf1b7-ed8a-4d79-9c81-12b822191243', 'dcb510c1-4b32-4d0c-90c9-d12cd418a80a', '55d1afe2-6d2c-436f-8a1a-57c3c3e9e708', '75a39a3a-f06c-40c0-9c07-441b149f6103'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:14.100435 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:14.100435 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:14.100435 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:14.158136 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Created reservations ['cda29dcc-cf23-4b45-81d3-5cd7570656e6'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:14.348720 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Created reservations ['3490ffd4-66c6-4b86-b781-d60818a2ba55', 'd7db8ec8-bf23-44f3-8e3f-ea31de82059d', '0f0a17ff-709d-4121-8fc9-5fad523056c8', '6c549af5-ae02-4791-9d12-52c11a80a4ad'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:14.497495 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:14.519946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:14.538170 n-d-760454-3 sudo[127340]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:14.539342 n-d-760454-3 sudo[127340]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:14.700035 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:14.700035 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:14.700035 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:14.880517 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:14.881439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:14.950347 n-d-760454-3 sudo[127323]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:14.953620 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3d701d75-ed87-4d96-ba1b-63f33781b018 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.780s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:14.957338 n-d-760454-3 sudo[127376]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:14.957842 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46ac574-cfd5-4883-bcc2-1de7a4d66953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d701d75-ed87-4d96-ba1b-63f33781b018', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:14.961009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42366fc-beb1-4f54-a770-83d8b22949c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:14.971010 n-d-760454-3 sudo[127376]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:15.048983 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Volume volume-3d701d75-ed87-4d96-ba1b-63f33781b018 (3d701d75-ed87-4d96-ba1b-63f33781b018): created successfully
Jan 25 13:28:15.060515 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42366fc-beb1-4f54-a770-83d8b22949c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:15.098772 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Flow 'volume_create_manager' (4a361a97-461f-4014-baa1-7d71bc084fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:15.162302 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cb0e723b-d09e-4a62-87d9-b816af696ab9 tempest-VolumesBackupsAdminTest-1175234813 None] Created volume successfully.
Jan 25 13:28:15.382596 n-d-760454-3 sudo[127335]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:15.384423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9510ed96-be40-491c-ab22-0d5a7e59f589 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.630s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:15.386883 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755449ae-81ee-40f9-abd8-31caffc0d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9510ed96-be40-491c-ab22-0d5a7e59f589', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:15.389916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c7a2e-b4ce-4244-b046-4403e15577a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:15.417402 n-d-760454-3 sudo[127340]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:15.419193 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.918s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:15.423947 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:15.459804 n-d-760454-3 sudo[127413]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:15.460343 n-d-760454-3 sudo[127413]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:15.465764 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Volume volume-9510ed96-be40-491c-ab22-0d5a7e59f589 (9510ed96-be40-491c-ab22-0d5a7e59f589): created successfully
Jan 25 13:28:15.494386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5c7a2e-b4ce-4244-b046-4403e15577a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:15.501547 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Flow 'volume_create_manager' (40aa46dc-c582-4ff7-b306-3e5ef13aacb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:15.632243 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c7373c4a-6f88-431a-8b6d-2e4b5537d641 tempest-VolumeQuotasAdminTestJSON-782648832 None] Created volume successfully.
Jan 25 13:28:16.126401 n-d-760454-3 sudo[127376]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:16.129038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.248s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:16.130245 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:16.175297 n-d-760454-3 sudo[127417]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:16.176691 n-d-760454-3 sudo[127417]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:16.954563 n-d-760454-3 sudo[127413]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:16.961610 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.536s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:16.961610 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:16.975298 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Deleted volume successfully.
Jan 25 13:28:17.071865 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7fbf6c5f-c71c-49b2-a56d-5c3d4c25f858 tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-0b0a02d6-6cff-42f3-816e-0840f702ed4a-delete_volume'" released by "delete_volume" :: held 7.845s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:17.271402 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Creating a new backup for volume volume-3d701d75-ed87-4d96-ba1b-63f33781b018. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:28:17.298133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:17.328245 n-d-760454-3 sudo[127417]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:17.332181 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.202s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:17.333898 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:17.339674 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-98281f8b-c4d9-481e-a9c5-5eb82d0a4d48 tempest-GroupsV314Test-253344037 None] Delete group completed successfully.
Jan 25 13:28:17.342791 n-d-760454-3 sudo[127433]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:28:17.344064 n-d-760454-3 sudo[127433]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:18.143815 n-d-760454-3 sudo[127433]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:18.145754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018" returned: 0 in 0.848s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:18.215284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:18.223825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:18.224249 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355928]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:28:18.225077 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:28:18.232664 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Creating iscsi_target for Volume ID: volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Created volume path /opt/stack/data/cinder/volumes/volume-3d701d75-ed87-4d96-ba1b-63f33781b018,
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018>
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:     incominguser vyo3iTPH2nx8GLVE8xGt irW52uFaTGMrA2Qm
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:28:18.368487 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:28:18.375691 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:18.638136 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e2b63d4c-233d-44ff-b370-5051ecb36eb6 tempest-VolumeQuotasAdminTestJSON-1374919636 None] Transfer volume completed successfully.
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018" returned: 0 in 0.912s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355928]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.037s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355928]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 25
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         DwGNjSHubhXZB8oNESu7
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:28:19.492484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:19.538024 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.196s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:19.538024 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355928]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:19.538024 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:19.748660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.221s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:19.749414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355928]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 25\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:19.752993 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:28:19.936288 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Initialize volume connection completed successfully.
Jan 25 13:28:20.894456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Lock "b'cinder-9510ed96-be40-491c-ab22-0d5a7e59f589-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:21.119836 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Skipping remove_export. No iscsi_target is presently exported for volume: 9510ed96-be40-491c-ab22-0d5a7e59f589
Jan 25 13:28:21.120864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:21.157480 n-d-760454-3 sudo[127589]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589
Jan 25 13:28:21.158734 n-d-760454-3 sudo[127589]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:22.183445 n-d-760454-3 sudo[127589]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:22.185731 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589" returned: 0 in 1.065s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:22.186938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:22.233356 n-d-760454-3 sudo[127606]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589
Jan 25 13:28:22.233990 n-d-760454-3 sudo[127606]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:22.842400 n-d-760454-3 sudo[127606]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:22.845320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589" returned: 0 in 0.658s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:22.847415 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:22.867542 n-d-760454-3 sudo[127621]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589
Jan 25 13:28:22.868656 n-d-760454-3 sudo[127621]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:23.843083 n-d-760454-3 sudo[127621]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:23.845689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9510ed96-be40-491c-ab22-0d5a7e59f589" returned: 0 in 0.998s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:23.847216 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Successfully deleted volume: 9510ed96-be40-491c-ab22-0d5a7e59f589
Jan 25 13:28:24.050973 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Created reservations ['2b694443-9bc7-49e4-a663-d812f9897902', '0b64e1e4-bf56-4341-b55f-0edc19529a1c', '73b5b0fe-8727-4540-813f-6d6c588c17ad', '15ff8ae2-1b8e-466f-be57-78e9a9871864'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:24.056926 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:24.056926 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:24.056926 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:24.276041 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:24.277422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:24.341154 n-d-760454-3 sudo[127645]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:24.345308 n-d-760454-3 sudo[127645]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:25.814355 n-d-760454-3 sudo[127645]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:25.817085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.539s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:25.819776 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:25.839823 n-d-760454-3 sudo[127663]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:25.841090 n-d-760454-3 sudo[127663]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:27.201027 n-d-760454-3 sudo[127663]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:27.203809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.383s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:27.206230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:27.215449 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Deleted volume successfully.
Jan 25 13:28:27.292332 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a0be5dc9-8c23-43a1-9469-b9caf59b0ce1 tempest-VolumeQuotasAdminTestJSON-1212389397 None] Lock "b'cinder-9510ed96-be40-491c-ab22-0d5a7e59f589-delete_volume'" released by "delete_volume" :: held 6.401s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:31.007406 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-79f4a9a8-e8ed-4656-90df-8825ce3cf347 req-e524afdf-df86-4d63-923a-314e1e340292 tempest-TestVolumeBackupRestore-965971121 None] Terminate volume connection completed successfully.
Jan 25 13:28:31.007992 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-79f4a9a8-e8ed-4656-90df-8825ce3cf347 req-e524afdf-df86-4d63-923a-314e1e340292 tempest-TestVolumeBackupRestore-965971121 None] Deleting attachment bd518bae-6e2e-4310-b009-66fa63bcf31d. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:28:31.012647 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:31.312138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.302s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:31.313096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af\n            Backing store flags: \n    Account information:\n        DwGNjSHubhXZB8oNESu7\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 28\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:31.314256 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-79f4a9a8-e8ed-4656-90df-8825ce3cf347 req-e524afdf-df86-4d63-923a-314e1e340292 tempest-TestVolumeBackupRestore-965971121 None] Removing iscsi_target for Volume ID: c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:31.317688 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:31.582196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af -f" returned: 0 in 0.265s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:31.582603 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:31.586675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:31.956290 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:28:31.996578 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:28:32.003472 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:28:32.050219 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Flow 'volume_create_manager' (f379ee4e-746f-45f6-8e45-08d1fa7c3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:32.073687 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a676be2a-d3eb-4081-b040-6b3e64da554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:32.155140 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:28:32.226042 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.383s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:32.230089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 28\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:32.245168 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a676be2a-d3eb-4081-b040-6b3e64da554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeManageAdminTest-Volume-1936571874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=7ed9b412-fef6-4903-8cd3-238d63d5b141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a807e2a2bc144723869f905dca21c051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:28:32Z,user_id='d5d8fb3802064e84b7a30286f69ef116',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:32.252202 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19c3d0-3485-417f-83e6-2f27c1fffaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:32.259197 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab19c3d0-3485-417f-83e6-2f27c1fffaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:32.264665 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3246ae06-c136-414b-99c3-8ae6d2290515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:32.270290 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3246ae06-c136-414b-99c3-8ae6d2290515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed9b412-fef6-4903-8cd3-238d63d5b141', 'volume_name': 'volume-7ed9b412-fef6-4903-8cd3-238d63d5b141', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:32.275705 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3ced0-9a3a-4797-b804-b7407de208ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:32.280682 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3ced0-9a3a-4797-b804-b7407de208ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:32.296499 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5cde17-30bc-4321-b408-e66d76dc3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:32.298540 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Volume 7ed9b412-fef6-4903-8cd3-238d63d5b141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed9b412-fef6-4903-8cd3-238d63d5b141', 'volume_size': 1}
Jan 25 13:28:32.301911 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:32.391393 n-d-760454-3 sudo[127697]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:28:32.394866 n-d-760454-3 sudo[127697]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:32.639096 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-79f4a9a8-e8ed-4656-90df-8825ce3cf347 req-e524afdf-df86-4d63-923a-314e1e340292 tempest-TestVolumeBackupRestore-965971121 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:32.639096 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:32.639096 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:33.563758 n-d-760454-3 sudo[127697]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:33.576306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.264s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:33.576306 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5cde17-30bc-4321-b408-e66d76dc3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed9b412-fef6-4903-8cd3-238d63d5b141', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:33.576306 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718617ea-46d5-4bac-84d4-c09b66f4d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:33.645331 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Volume volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 (7ed9b412-fef6-4903-8cd3-238d63d5b141): created successfully
Jan 25 13:28:33.648244 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718617ea-46d5-4bac-84d4-c09b66f4d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:33.652334 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Flow 'volume_create_manager' (f379ee4e-746f-45f6-8e45-08d1fa7c3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:33.707703 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-693239a2-b06e-4480-bb0c-39a88097cba0 tempest-VolumeManageAdminTest-584149017 None] Created volume successfully.
Jan 25 13:28:35.280338 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Lock "b'cinder-7ed9b412-fef6-4903-8cd3-238d63d5b141-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:35.420747 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Skipping remove_export. No iscsi_target is presently exported for volume: 7ed9b412-fef6-4903-8cd3-238d63d5b141
Jan 25 13:28:35.565071 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Created reservations ['277656f9-cefd-47cf-a9ec-4955acb893cf', '95e19ac6-a799-4979-9ebf-f716bee55d9b', '69b16a13-7272-492b-83e6-72e664d832c1', '5068c7a7-110e-4a01-8a28-cd4e26fd1829'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:35.567958 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:35.567958 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:35.567958 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:35.766321 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:35.767655 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:35.838762 n-d-760454-3 sudo[127761]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:35.839401 n-d-760454-3 sudo[127761]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:35.975478 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:28:35.976138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:35.977367 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:36.032121 n-d-760454-3 sudo[127768]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:36.048895 n-d-760454-3 sudo[127768]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:36.949772 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Lock "b'cinder-c0b767bf-1f7e-4423-bc30-2f58e51cc8af-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:36.994554 n-d-760454-3 sudo[127761]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:36.997258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.230s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:36.999771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:37.065891 n-d-760454-3 sudo[127790]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:37.079186 n-d-760454-3 sudo[127790]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:37.222002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:37.383494 n-d-760454-3 sudo[127768]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:37.386486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.409s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:37.388517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:37.479057 n-d-760454-3 sudo[127801]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:37.479642 n-d-760454-3 sudo[127801]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:37.495550 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Lock "b'cinder-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:37.537474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.318s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:37.538187 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355320]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 28\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:37.539293 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Skipping remove_export. No iscsi_target is presently exported for volume: c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:37.540621 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:37.633815 n-d-760454-3 sudo[127805]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:37.637381 n-d-760454-3 sudo[127805]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:37.815307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:38.222317 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.414s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:38.223351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356992]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 28\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:38.224481 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Skipping remove_export. No iscsi_target is presently exported for volume: c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:28:38.226259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:38.322538 n-d-760454-3 sudo[127819]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:28:38.323106 n-d-760454-3 sudo[127819]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:39.198801 n-d-760454-3 sudo[127790]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:39.221528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Flow 'volume_manage_existing_manager' (83c73820-6b03-4131-b629-b6cb47a67683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:39.223832 n-d-760454-3 sudo[127801]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:39.232921 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, manage_existing.start' (a73b9b15-4f87-46fb-a32d-e599355006a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:39.240176 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, manage_existing.start' (a73b9b15-4f87-46fb-a32d-e599355006a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:39.249369 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.manage_existing.PrepareForQuotaReservationTask;volume:manage_existing' (6d9cfd5a-4e74-4407-b6e6-0ea807050ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:39.251141 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:39.306414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.307s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:39.307988 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.920s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:39.311028 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:39.334552 n-d-760454-3 sudo[127805]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:39.337432 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Unmanaged volume successfully.
Jan 25 13:28:39.342307 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:39.350721 n-d-760454-3 sudo[127833]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141
Jan 25 13:28:39.355655 n-d-760454-3 sudo[127833]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:39.368935 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 1.828s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:39.371093 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:39.457893 n-d-760454-3 sudo[127836]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:39.458569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a1dee3cc-6f98-4ce3-b3bf-a43d0b47277b tempest-VolumeManageAdminTest-1655081665 None] Lock "b'cinder-7ed9b412-fef6-4903-8cd3-238d63d5b141-delete_volume'" released by "delete_volume" :: held 4.177s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:39.464978 n-d-760454-3 sudo[127836]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:40.335986 n-d-760454-3 sudo[127819]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:40.340036 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c" returned: 0 in 2.114s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:40.344625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:40.425132 n-d-760454-3 sudo[127852]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:28:40.428277 n-d-760454-3 sudo[127852]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:40.755442 n-d-760454-3 sudo[127836]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:40.758007 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 1.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:40.760498 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:40.820572 n-d-760454-3 sudo[127858]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:40.827609 n-d-760454-3 sudo[127858]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:41.087061 n-d-760454-3 sudo[127833]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:41.090174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141" returned: 0 in 1.838s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:41.095295 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.manage_existing.PrepareForQuotaReservationTask;volume:manage_existing' (6d9cfd5a-4e74-4407-b6e6-0ea807050ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'size': 1, 'volume_type_id': 'abff4454-a39c-478f-ac30-d3a463f89de6', 'volume_properties': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeManageAdminTest-volume-1462499758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=5ec737c8-1703-4311-8c79-d0a46e6d5c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78dd31f3feb5467dbf19050182d5f61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=0,snapshot_id=None,snapshots=<?>,source_volid=None,status='managing',terminated_at=None,updated_at=None,user_id='874050766f8349168f6a1366f138352e',volume_attachment=<?>,volume_type=<?>,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6), 'volume_spec': {'status': 'managing', 'volume_name': 'volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28', 'volume_id': '5ec737c8-1703-4311-8c79-d0a46e6d5c28'}}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:41.098781 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.api.create_volume.QuotaReserveTask;volume:create' (e77aa98c-94ff-4571-8cc2-36cd4b556e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:41.430758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Created reservations ['58daadee-658e-419e-96b0-060574290673', '044a51ef-5d4b-403f-ab7c-8f03c187ec54'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:41.434077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.api.create_volume.QuotaReserveTask;volume:create' (e77aa98c-94ff-4571-8cc2-36cd4b556e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'reservations': ['58daadee-658e-419e-96b0-060574290673', '044a51ef-5d4b-403f-ab7c-8f03c187ec54']}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:41.437685 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.manage_existing.ManageExistingTask;volume:manage_existing' (6904fb2e-ae6a-4a99-b0df-8fac62d4683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:41.440570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:41.480001 n-d-760454-3 sudo[127860]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141
Jan 25 13:28:41.481987 n-d-760454-3 sudo[127860]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:42.038617 n-d-760454-3 sudo[127852]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:42.041378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c" returned: 0 in 1.697s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:42.043418 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:42.102305 n-d-760454-3 sudo[127864]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:28:42.103200 n-d-760454-3 sudo[127864]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:42.686719 n-d-760454-3 sudo[127858]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:42.689556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c0b767bf-1f7e-4423-bc30-2f58e51cc8af" returned: 0 in 1.929s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:42.692818 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Successfully deleted volume: c0b767bf-1f7e-4423-bc30-2f58e51cc8af
Jan 25 13:28:42.871715 n-d-760454-3 sudo[127860]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:42.882312 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7ed9b412-fef6-4903-8cd3-238d63d5b141" returned: 0 in 1.439s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:42.910506 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Created reservations ['4f3e385d-b343-4bbd-b9cf-f04caf52dba0', '14164c44-ef98-4bef-b7bf-6855ef442657', '6021feaf-cad9-4ecc-81d1-7191f005bcb2', '7cc5bf2f-6692-4cc8-a79b-1c407bf1c97f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:42.923760 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:42.923760 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:42.923760 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:42.938792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): lvrename stack-volumes-lvmdriver-1 volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:43.092092 n-d-760454-3 sudo[127864]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:43.094701 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c" returned: 0 in 1.051s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:43.095895 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Successfully deleted volume: c2332e12-ec00-451e-89fc-3a4e9a0cdf4c
Jan 25 13:28:43.127394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:43.131402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:43.206545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "lvrename stack-volumes-lvmdriver-1 volume-7ed9b412-fef6-4903-8cd3-238d63d5b141 volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28" returned: 0 in 0.267s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:43.207324 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357144]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:28:43.247512 n-d-760454-3 sudo[127895]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:43.248351 n-d-760454-3 sudo[127895]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:43.260187 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.manage_existing.ManageExistingTask;volume:manage_existing' (6904fb2e-ae6a-4a99-b0df-8fac62d4683d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeManageAdminTest-volume-1462499758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=5ec737c8-1703-4311-8c79-d0a46e6d5c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78dd31f3feb5467dbf19050182d5f61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='managing',terminated_at=None,updated_at=None,user_id='874050766f8349168f6a1366f138352e',volume_attachment=<?>,volume_type=<?>,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:43.270127 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.api.create_volume.QuotaCommitTask;volume:create' (8000b479-a3dc-48f5-80b0-a590decfd62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:43.381027 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.api.create_volume.QuotaCommitTask;volume:create' (8000b479-a3dc-48f5-80b0-a590decfd62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'volume_properties': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeManageAdminTest-volume-1462499758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=5ec737c8-1703-4311-8c79-d0a46e6d5c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78dd31f3feb5467dbf19050182d5f61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='managing',terminated_at=None,updated_at=None,user_id='874050766f8349168f6a1366f138352e',volume_attachment=<?>,volume_type=<?>,volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:43.389635 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, manage_existing.end' (cd04f5ef-45c5-40e1-8191-2fd814664d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:43.407171 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Created reservations ['7ac4b8b2-57d2-4064-8975-88e9ad161fc5', '319d187d-c7ba-4ff7-80ae-76eeb33d98d9', '47c73a65-2f13-4b9f-a661-839124e6892f', 'f8d0ee43-dee7-457d-9cf7-ab787e97e962'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:43.411099 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:43.411099 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:43.411099 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:43.450956 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Volume volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28 (5ec737c8-1703-4311-8c79-d0a46e6d5c28): created successfully
Jan 25 13:28:43.453436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, manage_existing.end' (cd04f5ef-45c5-40e1-8191-2fd814664d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:43.467916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Flow 'volume_manage_existing_manager' (83c73820-6b03-4131-b629-b6cb47a67683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:43.470613 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fd043649-b49f-4a23-ae40-8ec529cdb086 tempest-VolumeManageAdminTest-1655081665 None] Manage existing volume completed successfully.
Jan 25 13:28:43.658626 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:43.659214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:43.734908 n-d-760454-3 sudo[127908]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:43.736810 n-d-760454-3 sudo[127908]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:44.809734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Lock "b'cinder-5ec737c8-1703-4311-8c79-d0a46e6d5c28-delete_volume'" acquired by "delete_volume" :: waited 0.061s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:44.842388 n-d-760454-3 sudo[127895]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:44.850808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.719s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:44.855687 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:44.978123 n-d-760454-3 sudo[127914]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:44.979750 n-d-760454-3 sudo[127914]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:45.224330 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Skipping remove_export. No iscsi_target is presently exported for volume: 5ec737c8-1703-4311-8c79-d0a46e6d5c28
Jan 25 13:28:45.226475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:45.319654 n-d-760454-3 sudo[127916]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28
Jan 25 13:28:45.324036 n-d-760454-3 sudo[127916]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:45.640030 n-d-760454-3 sudo[127908]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:45.646198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.984s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:45.647235 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:45.717364 n-d-760454-3 sudo[127920]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:45.720698 n-d-760454-3 sudo[127920]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:46.530939 n-d-760454-3 sudo[127916]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:46.534328 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28" returned: 0 in 1.307s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:46.536184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:46.599365 n-d-760454-3 sudo[127926]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28
Jan 25 13:28:46.600896 n-d-760454-3 sudo[127926]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:46.841925 n-d-760454-3 sudo[127914]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:46.845314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:46.847255 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:46.854451 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Deleted volume successfully.
Jan 25 13:28:46.921068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f43d5df5-459c-4d80-b054-8b7389ec584b tempest-TestVolumeBackupRestore-965971121 None] Lock "b'cinder-c0b767bf-1f7e-4423-bc30-2f58e51cc8af-delete_volume'" released by "delete_volume" :: held 9.971s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:47.335061 n-d-760454-3 sudo[127920]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:47.337698 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.692s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:47.342341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:47.343233 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Deleted volume successfully.
Jan 25 13:28:47.388667 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-29a8d42e-860f-4949-962a-63d476d33ce3 tempest-TestVolumeBackupRestore-965971121 None] Lock "b'cinder-c2332e12-ec00-451e-89fc-3a4e9a0cdf4c-delete_volume'" released by "delete_volume" :: held 9.893s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:47.524157 n-d-760454-3 sudo[127926]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:47.527672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28" returned: 0 in 0.991s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:47.531451 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:47.576263 n-d-760454-3 sudo[127932]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28
Jan 25 13:28:47.578018 n-d-760454-3 sudo[127932]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:48.447475 n-d-760454-3 sudo[127932]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:48.450173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5ec737c8-1703-4311-8c79-d0a46e6d5c28" returned: 0 in 0.919s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:48.451474 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Successfully deleted volume: 5ec737c8-1703-4311-8c79-d0a46e6d5c28
Jan 25 13:28:48.601838 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Created reservations ['241194c3-b8f2-4184-8067-9a9d89a86370', '9023424c-f1d5-405f-9510-ae1867d3a9ac', 'fe5db15a-f9b5-4cbc-b47d-21358093e6e1', 'ba9af41c-40b3-4016-b2ad-5a9b9bf819fe'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:48.606004 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:48.606004 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:48.606004 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:48.777150 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:48.778428 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:48.844850 n-d-760454-3 sudo[127941]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:48.845668 n-d-760454-3 sudo[127941]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:49.664316 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:28:49.681359 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:28:49.683738 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:28:49.715989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Flow 'volume_create_manager' (15cf845c-8d1a-4492-a087-9c2d3c674cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:49.721047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef39d12-5193-409a-a7fb-e042de1539f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:49.787537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:28:49.851834 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef39d12-5193-409a-a7fb-e042de1539f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-554941639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=f14e36fc-1c83-4425-8995-cf788b76a65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1577bd61a845a7a5a2de139637eb92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:28:49Z,user_id='24f334a120d6457f9644f80c1a1cdc54',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:49.857149 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631db342-dde5-4ab8-9bad-8d70fadd0c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:49.863080 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631db342-dde5-4ab8-9bad-8d70fadd0c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:49.869451 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b4e18d-feaf-4e0e-89be-1656fb953196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:49.875174 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b4e18d-feaf-4e0e-89be-1656fb953196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14e36fc-1c83-4425-8995-cf788b76a65c', 'volume_name': 'volume-f14e36fc-1c83-4425-8995-cf788b76a65c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:49.881328 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d26954-dc0d-406e-aa0d-3e7aa46940ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:49.902290 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d26954-dc0d-406e-aa0d-3e7aa46940ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:49.909108 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9bf477-76db-4d0f-a47b-9874d44a3ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:49.911136 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Volume f14e36fc-1c83-4425-8995-cf788b76a65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14e36fc-1c83-4425-8995-cf788b76a65c', 'volume_size': 1}
Jan 25 13:28:49.914471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f14e36fc-1c83-4425-8995-cf788b76a65c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:50.036442 n-d-760454-3 sudo[127945]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f14e36fc-1c83-4425-8995-cf788b76a65c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:28:50.037397 n-d-760454-3 sudo[127945]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:50.041465 n-d-760454-3 sudo[127941]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:50.044695 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.265s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:50.047429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:50.130822 n-d-760454-3 sudo[127947]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:28:50.131625 n-d-760454-3 sudo[127947]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:51.766242 n-d-760454-3 sudo[127947]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:51.769689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.721s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:51.772710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:28:51.788602 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Deleted volume successfully.
Jan 25 13:28:51.829790 n-d-760454-3 sudo[127945]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:51.833563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f14e36fc-1c83-4425-8995-cf788b76a65c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.919s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:51.840907 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9bf477-76db-4d0f-a47b-9874d44a3ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14e36fc-1c83-4425-8995-cf788b76a65c', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:51.848733 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebbc2eb-9893-4740-b5f2-4da0e5402d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:28:51.909131 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cc082328-0393-4665-ad42-5aff2088c282 tempest-VolumeManageAdminTest-1655081665 None] Lock "b'cinder-5ec737c8-1703-4311-8c79-d0a46e6d5c28-delete_volume'" released by "delete_volume" :: held 7.102s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:28:51.933983 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Volume volume-f14e36fc-1c83-4425-8995-cf788b76a65c (f14e36fc-1c83-4425-8995-cf788b76a65c): created successfully
Jan 25 13:28:51.937895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebbc2eb-9893-4740-b5f2-4da0e5402d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:28:51.944105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Flow 'volume_create_manager' (15cf845c-8d1a-4492-a087-9c2d3c674cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:28:52.015396 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3c9d0634-8802-4c0f-9e10-842c6e896dff tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Created volume successfully.
Jan 25 13:28:55.049398 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Lock "b'cinder-f14e36fc-1c83-4425-8995-cf788b76a65c-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:28:55.235058 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Skipping remove_export. No iscsi_target is presently exported for volume: f14e36fc-1c83-4425-8995-cf788b76a65c
Jan 25 13:28:55.252915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:55.318458 n-d-760454-3 sudo[127994]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c
Jan 25 13:28:55.320137 n-d-760454-3 sudo[127994]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:56.355726 n-d-760454-3 sudo[127994]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:56.359963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c" returned: 0 in 1.123s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:56.362331 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:56.413972 n-d-760454-3 sudo[127998]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c
Jan 25 13:28:56.415685 n-d-760454-3 sudo[127998]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:57.310705 n-d-760454-3 sudo[127998]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:57.314480 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c" returned: 0 in 0.952s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:57.317126 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:57.344704 n-d-760454-3 sudo[128002]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c
Jan 25 13:28:57.346065 n-d-760454-3 sudo[128002]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:28:58.443224 n-d-760454-3 sudo[128002]: pam_unix(sudo:session): session closed for user root
Jan 25 13:28:58.445741 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f14e36fc-1c83-4425-8995-cf788b76a65c" returned: 0 in 1.128s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:28:58.446993 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Successfully deleted volume: f14e36fc-1c83-4425-8995-cf788b76a65c
Jan 25 13:28:58.621877 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Created reservations ['c845528a-88b6-402e-813b-7030ea17df8d', 'c302ceb5-6d82-4e7b-b9ce-dbd27be9396b', '614ad63b-61a6-40b9-9666-6d7601009555', 'fbd1586a-9b0f-4654-a59a-bb6208291a43'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:28:58.626182 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:28:58.626182 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:28:58.626182 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:28:58.807976 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:28:58.809228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:28:58.921287 n-d-760454-3 sudo[128039]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:28:58.929269 n-d-760454-3 sudo[128039]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:00.193654 n-d-760454-3 sudo[128039]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:00.196306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.387s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:00.198158 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:00.287521 n-d-760454-3 sudo[128058]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:29:00.288406 n-d-760454-3 sudo[128058]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:01.773969 n-d-760454-3 sudo[128058]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:01.777824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.579s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:01.782061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:29:01.807977 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Deleted volume successfully.
Jan 25 13:29:01.883166 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d3d5264e-3fad-4ac9-b7d3-82fb8219c4f3 tempest-VolumeQuotasNegativeTestJSON-2021282084 None] Lock "b'cinder-f14e36fc-1c83-4425-8995-cf788b76a65c-delete_volume'" released by "delete_volume" :: held 6.834s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:29:10.285636 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:29:10.302112 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:29:10.302112 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:29:10.321252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Flow 'volume_create_manager' (20678720-906e-4f96-b1ae-d036a75aa391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:29:10.339534 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802e3f26-c72a-476a-9c43-b28a73c886c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:10.409229 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:29:10.460840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802e3f26-c72a-476a-9c43-b28a73c886c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-84455731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=f60d134c-d4a6-4aa0-a120-98c2ed433a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732f71db9be4415e9edee264aea92d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:29:10Z,user_id='d78be6c90a2f41cfb0d1715ffdaa5140',volume_attachment=<?>,volume_type=VolumeType(798ff955-567b-4a3d-a7c7-c7f327d1b2f6),volume_type_id=798ff955-567b-4a3d-a7c7-c7f327d1b2f6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:10.464791 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15274027-480f-41f4-8213-73fd79c8295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:10.469326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15274027-480f-41f4-8213-73fd79c8295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:10.474006 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d75451-db3e-4e84-a2f1-66c3bb645e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:10.478173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d75451-db3e-4e84-a2f1-66c3bb645e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60d134c-d4a6-4aa0-a120-98c2ed433a20', 'volume_name': 'volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:10.485652 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8119e6-411a-49ad-9f98-5677aac59177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:10.488989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8119e6-411a-49ad-9f98-5677aac59177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:10.492840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9847c9-a641-4df1-a9ee-01f382d718a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:10.494547 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Volume f60d134c-d4a6-4aa0-a120-98c2ed433a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20', 'volume_size': 1}
Jan 25 13:29:10.496227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:10.521499 n-d-760454-3 sudo[128161]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:29:10.522098 n-d-760454-3 sudo[128161]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:11.407084 n-d-760454-3 sudo[128161]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:11.409693 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.913s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:11.414666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9847c9-a641-4df1-a9ee-01f382d718a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:11.418194 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2006185-d811-45d2-9c8c-4368479e96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:11.475854 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Volume volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 (f60d134c-d4a6-4aa0-a120-98c2ed433a20): created successfully
Jan 25 13:29:11.478265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2006185-d811-45d2-9c8c-4368479e96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:11.494814 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Flow 'volume_create_manager' (20678720-906e-4f96-b1ae-d036a75aa391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:29:11.569969 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b07cfc85-a5f8-4bbd-9096-f58649b4af35 tempest-VolumeTypesAccessTest-884132011 None] Created volume successfully.
Jan 25 13:29:13.394456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Lock "b'cinder-f60d134c-d4a6-4aa0-a120-98c2ed433a20-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:29:13.580986 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Skipping remove_export. No iscsi_target is presently exported for volume: f60d134c-d4a6-4aa0-a120-98c2ed433a20
Jan 25 13:29:13.582465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:13.634231 n-d-760454-3 sudo[128201]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20
Jan 25 13:29:13.635232 n-d-760454-3 sudo[128201]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:14.481500 n-d-760454-3 sudo[128201]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:14.486150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20" returned: 0 in 0.902s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:14.490498 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:14.536448 n-d-760454-3 sudo[128206]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20
Jan 25 13:29:14.554813 n-d-760454-3 sudo[128206]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:15.516462 n-d-760454-3 sudo[128206]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:15.520008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20" returned: 0 in 1.029s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:15.523120 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:15.561874 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:29:15.575510 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:29:15.575510 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:29:15.585714 n-d-760454-3 sudo[128212]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20
Jan 25 13:29:15.586292 n-d-760454-3 sudo[128212]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:15.621887 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (e956dae2-2c8c-4ff3-bb7f-1b1d63803ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:29:15.630314 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cd7a7c-7648-4bcb-8b60-0a1a7799e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:15.699697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:29:15.772834 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cd7a7c-7648-4bcb-8b60-0a1a7799e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-405699388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc05b9d4e53d453f86824a61b65052a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:29:15Z,user_id='e4fb5ea020004e8f99712ef8d9fe0736',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:15.782212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50579846-d052-4443-8a58-883ccd1fd34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:15.785632 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50579846-d052-4443-8a58-883ccd1fd34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:15.792704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1834ee-c66d-43b0-9c1d-b3162ffc8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:16.010706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1834ee-c66d-43b0-9c1d-b3162ffc8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'volume_name': 'volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c3b9c50>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:16.036044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a1c36-37ae-4eed-a4e4-2cd5b9cf1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:16.039815 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711a1c36-37ae-4eed-a4e4-2cd5b9cf1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:16.055502 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a17e8a-9542-43d7-85bf-2a3208c73c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:16.065874 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c3b9c50>}
Jan 25 13:29:16.070459 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Cloning 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:29:16.636997 n-d-760454-3 sudo[128212]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:16.642113 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-f60d134c-d4a6-4aa0-a120-98c2ed433a20" returned: 0 in 1.119s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:16.645431 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Successfully deleted volume: f60d134c-d4a6-4aa0-a120-98c2ed433a20
Jan 25 13:29:16.754302 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-969725196 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-969725196, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:29:16.755675 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-969725196 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-969725196, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:29:16.835729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Created reservations ['58acd693-3af5-4a02-b3bf-40620e773d55', 'fe4204dd-b792-4e85-9ea1-84a50e28481a', 'e61436c2-9cc2-4385-a9a6-1620283930bc', 'c0b55676-fca8-453c-8849-071109afc68d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:29:16.854277 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:29:16.854277 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:29:16.854277 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:29:17.064666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:29:17.066018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:17.127511 n-d-760454-3 sudo[128221]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:29:17.128201 n-d-760454-3 sudo[128221]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:19.107584 n-d-760454-3 sudo[128221]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:19.113904 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.044s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:19.113904 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:19.173262 n-d-760454-3 sudo[128227]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:29:19.174096 n-d-760454-3 sudo[128227]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:20.373688 n-d-760454-3 sudo[128227]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:20.377602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.264s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:20.380105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:29:20.388770 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Deleted volume successfully.
Jan 25 13:29:20.440068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-618e237a-34fa-45d1-a5aa-4d679549e697 tempest-VolumeTypesAccessTest-884132011 None] Lock "b'cinder-f60d134c-d4a6-4aa0-a120-98c2ed433a20-delete_volume'" released by "delete_volume" :: held 7.045s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:29:35.971280 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:29:35.972185 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:29:35.973068 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:36.058414 n-d-760454-3 sudo[128402]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:29:36.059289 n-d-760454-3 sudo[128402]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:37.126163 n-d-760454-3 sudo[128402]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:37.132342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.159s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:37.134056 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:37.166295 n-d-760454-3 sudo[128406]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:29:37.166889 n-d-760454-3 sudo[128406]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:38.268349 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:29:38.292299 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:29:38.293364 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:29:38.323492 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Flow 'volume_create_manager' (4380be22-c6c7-4cee-baa4-fa25f135703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:29:38.331710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a037236-b3d2-4ea0-b828-78341d57c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:38.590399 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:29:38.631333 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a037236-b3d2-4ea0-b828-78341d57c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1889150753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b4c9740e-05bf-4138-8df6-29701f227466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75213e7dd7164beb83777136c297a09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:29:36Z,user_id='45da4d0b090f4bad92daafa4ef7eaa80',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:38.636587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b549ef7-3c7e-4dd2-9f30-46432277002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:38.639033 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b549ef7-3c7e-4dd2-9f30-46432277002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:38.644688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c10435-a58f-48ee-b4c6-228bb895861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:38.648858 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c10435-a58f-48ee-b4c6-228bb895861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c9740e-05bf-4138-8df6-29701f227466', 'volume_name': 'volume-b4c9740e-05bf-4138-8df6-29701f227466', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:38.651330 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb630c14-8af2-4467-9935-5e0748a4cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:38.653738 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb630c14-8af2-4467-9935-5e0748a4cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:38.656250 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd93f1b-a242-4bde-8f62-2eb54e11bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:38.657568 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Volume b4c9740e-05bf-4138-8df6-29701f227466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c9740e-05bf-4138-8df6-29701f227466', 'volume_size': 1}
Jan 25 13:29:38.658683 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b4c9740e-05bf-4138-8df6-29701f227466 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:38.700118 n-d-760454-3 sudo[128410]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b4c9740e-05bf-4138-8df6-29701f227466 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:29:38.704245 n-d-760454-3 sudo[128410]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:39.158078 n-d-760454-3 sudo[128406]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:39.197511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.026s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:39.197511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:29:44.690705 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 28.62 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:29:44.691500 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Image download 616.00 MB at 21.53 MB/s
Jan 25 13:29:44.759939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:44.931895 n-d-760454-3 sudo[128488]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1
Jan 25 13:29:44.932894 n-d-760454-3 sudo[128488]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:45.320807 n-d-760454-3 sudo[128488]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:45.323138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1" returned: 0 in 0.563s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:45.324136 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user e4fb5ea020004e8f99712ef8d9fe0736. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:29:46.374560 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:46.697991 n-d-760454-3 sudo[128501]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1
Jan 25 13:29:46.703184 n-d-760454-3 sudo[128501]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:46.712228 n-d-760454-3 sudo[128410]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:46.716950 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b4c9740e-05bf-4138-8df6-29701f227466 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 8.057s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:46.723521 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd93f1b-a242-4bde-8f62-2eb54e11bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c9740e-05bf-4138-8df6-29701f227466', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:46.734015 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a34e0e-c8ad-4275-a1bf-b6474e7fb546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:29:46.800226 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Volume volume-b4c9740e-05bf-4138-8df6-29701f227466 (b4c9740e-05bf-4138-8df6-29701f227466): created successfully
Jan 25 13:29:46.809525 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a34e0e-c8ad-4275-a1bf-b6474e7fb546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:29:46.812498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Flow 'volume_create_manager' (4380be22-c6c7-4cee-baa4-fa25f135703a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:29:46.878197 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-de14c680-26dd-47f4-82da-afbdc16f22c6 tempest-VolumesMetadataTest-885619495 None] Created volume successfully.
Jan 25 13:29:47.706213 n-d-760454-3 sudo[128501]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:47.708261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1" returned: 0 in 1.341s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:47.711135 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:47.740230 n-d-760454-3 sudo[128537]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:29:47.742403 n-d-760454-3 sudo[128537]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:48.818331 n-d-760454-3 sudo[128537]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:48.845221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.124s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:48.998564 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:29:49.125051 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpb02p5m6z {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:49.388804 n-d-760454-3 sudo[128568]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpb02p5m6z
Jan 25 13:29:49.389409 n-d-760454-3 sudo[128568]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:50.192338 n-d-760454-3 sudo[128568]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:50.195018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpb02p5m6z" returned: 0 in 1.070s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:50.197213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:50.405923 n-d-760454-3 sudo[128572]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1
Jan 25 13:29:50.406474 n-d-760454-3 sudo[128572]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:51.195236 n-d-760454-3 sudo[128572]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:51.197722 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1" returned: 0 in 1.000s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:51.200109 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:29:51.201018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:51.221121 n-d-760454-3 sudo[128577]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3 oflag=direct
Jan 25 13:29:51.222291 n-d-760454-3 sudo[128577]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:51.286662 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Lock "b'cinder-b4c9740e-05bf-4138-8df6-29701f227466-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:29:51.576604 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Skipping remove_export. No iscsi_target is presently exported for volume: b4c9740e-05bf-4138-8df6-29701f227466
Jan 25 13:29:51.579025 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:51.664342 n-d-760454-3 sudo[128580]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466
Jan 25 13:29:51.670610 n-d-760454-3 sudo[128580]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:52.437375 n-d-760454-3 sudo[128577]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:52.441913 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3 oflag=direct" returned: 0 in 1.240s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:52.444848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:52.496367 n-d-760454-3 sudo[128601]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3
Jan 25 13:29:52.497975 n-d-760454-3 sudo[128601]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:52.930565 n-d-760454-3 sudo[128580]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:52.995681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466" returned: 0 in 1.417s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:53.047348 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:53.096499 n-d-760454-3 sudo[128625]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466
Jan 25 13:29:53.097131 n-d-760454-3 sudo[128625]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:53.101652 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Terminate volume connection completed successfully.
Jan 25 13:29:53.241886 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:53.428138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.189s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:53.428682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018\n            Backing store flags: \n    Account information:\n        vyo3iTPH2nx8GLVE8xGt\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:29:53.429703 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Removing iscsi_target for Volume ID: 3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:53.434516 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:53.822182 n-d-760454-3 sudo[128625]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:53.824851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466" returned: 0 in 0.778s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:53.827682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:53.886452 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-3d701d75-ed87-4d96-ba1b-63f33781b018 -f" returned: 0 in 0.412s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:53.886807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:29:53.891719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:53.913183 n-d-760454-3 sudo[128659]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466
Jan 25 13:29:53.935837 n-d-760454-3 sudo[128659]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:54.202900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.310s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:54.203759 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:29:54.208518 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-92764e6f-8631-487d-b11a-b4a16682d2ab tempest-VolumesBackupsAdminTest-1175234813 None] Remove volume export completed successfully.
Jan 25 13:29:55.101465 n-d-760454-3 sudo[128659]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:55.104180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b4c9740e-05bf-4138-8df6-29701f227466" returned: 0 in 1.276s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:55.107064 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Successfully deleted volume: b4c9740e-05bf-4138-8df6-29701f227466
Jan 25 13:29:55.230569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-3d701d75-ed87-4d96-ba1b-63f33781b018-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:29:55.347073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Created reservations ['bce8a118-4474-449d-9ab3-bd19ae109f0f', '0eb6ae15-1d41-4f4f-ab8c-e94abe6a62cc', '194f3880-73b5-4d27-96dd-0253bd6b2e7d', '5acf2e71-45d5-48ab-9815-837b7e4305ee'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:29:55.349763 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:29:55.349763 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:29:55.349763 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:29:55.641005 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:55.759592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:29:55.773586 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:55.795206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.224s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:55.795865 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:29:55.798282 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Skipping remove_export. No iscsi_target is presently exported for volume: 3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:55.801328 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:55.816302 n-d-760454-3 sudo[128716]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:29:55.817327 n-d-760454-3 sudo[128716]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:55.854684 n-d-760454-3 sudo[128717]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:55.855402 n-d-760454-3 sudo[128717]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:56.744431 n-d-760454-3 sudo[128716]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:56.747639 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.987s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:56.749569 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:56.779389 n-d-760454-3 sudo[128746]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:29:56.780200 n-d-760454-3 sudo[128746]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:57.175147 n-d-760454-3 sudo[128717]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:57.178501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018" returned: 0 in 1.377s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:57.179980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:57.217610 n-d-760454-3 sudo[128752]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:57.218204 n-d-760454-3 sudo[128752]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:57.806901 n-d-760454-3 sudo[128752]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:57.811461 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018" returned: 0 in 0.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:57.814924 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:57.908737 n-d-760454-3 sudo[128758]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:57.913475 n-d-760454-3 sudo[128758]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:29:58.160105 n-d-760454-3 sudo[128746]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:58.162686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.413s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:58.164414 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:29:58.174671 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Deleted volume successfully.
Jan 25 13:29:58.348895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-eae5c5d8-be2e-4178-a80e-42ba9f41fef5 tempest-VolumesMetadataTest-885619495 None] Lock "b'cinder-b4c9740e-05bf-4138-8df6-29701f227466-delete_volume'" released by "delete_volume" :: held 7.063s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:29:59.181090 n-d-760454-3 sudo[128758]: pam_unix(sudo:session): session closed for user root
Jan 25 13:29:59.183474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3d701d75-ed87-4d96-ba1b-63f33781b018" returned: 0 in 1.369s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:29:59.185752 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Successfully deleted volume: 3d701d75-ed87-4d96-ba1b-63f33781b018
Jan 25 13:29:59.383028 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Created reservations ['4fb00d5a-2186-4e7f-afe7-b73ede1a4fe5', '8019aafb-5aed-4258-8afd-e22e37987750', '37ac93f0-d373-4a06-b3fe-262c1934ca28', '388950b0-d8bc-467b-8dee-65a5d869ada9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:29:59.408841 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:29:59.408841 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:29:59.408841 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:29:59.640073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:29:59.641396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:29:59.666633 n-d-760454-3 sudo[128781]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:29:59.667167 n-d-760454-3 sudo[128781]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:00.265956 n-d-760454-3 sudo[128781]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:00.294220 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:00.294220 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:00.291571 n-d-760454-3 sudo[128786]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:30:00.292396 n-d-760454-3 sudo[128786]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:01.080343 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-4de584c6-296c-4731-a230-55cc1a91159e-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:30:01.373070 n-d-760454-3 sudo[128786]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:01.375034 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.105s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:01.376592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:30:01.381682 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Deleted volume successfully.
Jan 25 13:30:01.471355 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:01.569660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.099s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:01.570261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:01.570995 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Skipping remove_export. No iscsi_target is presently exported for volume: 4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:30:01.597977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:01.589996 n-d-760454-3 sudo[128802]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:30:01.590546 n-d-760454-3 sudo[128802]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:01.633901 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ae611bd6-654e-48f9-ab98-3e29e2e2eb19 tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-3d701d75-ed87-4d96-ba1b-63f33781b018-delete_volume'" released by "delete_volume" :: held 6.401s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:30:02.437754 n-d-760454-3 sudo[128802]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:02.440426 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e" returned: 0 in 0.868s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:02.441588 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:02.490563 n-d-760454-3 sudo[128806]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:30:02.491757 n-d-760454-3 sudo[128806]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:03.324321 n-d-760454-3 sudo[128806]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:03.330880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e" returned: 0 in 0.885s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:03.330880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:03.368425 n-d-760454-3 sudo[128810]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:30:03.369807 n-d-760454-3 sudo[128810]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:04.147928 n-d-760454-3 sudo[128810]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:04.150536 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4de584c6-296c-4731-a230-55cc1a91159e" returned: 0 in 0.821s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:04.153003 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Successfully deleted volume: 4de584c6-296c-4731-a230-55cc1a91159e
Jan 25 13:30:04.317381 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Created reservations ['4c3eb609-1c73-43fd-be23-ac8ea59469be', '17ac5f43-605a-4d41-adaa-5a2ffbce3e04', '6b87d158-ddb6-4f05-aa93-19b19df67877', 'aac980b6-9bae-463b-b228-b44eb58fbd3b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:30:04.319967 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:30:04.319967 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:30:04.319967 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:30:04.639959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:30:04.641338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:04.680115 n-d-760454-3 sudo[128834]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:30:04.681443 n-d-760454-3 sudo[128834]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:05.098720 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:30:05.119585 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:30:05.121006 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:30:05.200151 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (85daca78-588b-4faa-b22e-946a2153df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:05.218793 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0e6620-1b32-48b3-892b-ce55c9886626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:05.357824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:30:05.556744 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0e6620-1b32-48b3-892b-ce55c9886626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1393720036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=89bb366f-0d1b-41fd-8cd8-851b3606d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330f089a4942a7a8f1eba58db88685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:30:05Z,user_id='253e9e6711fa4978b18bbf3697b15cbf',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:05.556744 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de435511-5af2-43ae-b6db-d45012881d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:05.558041 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de435511-5af2-43ae-b6db-d45012881d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:05.570239 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242d2468-b26c-4bdf-a6ca-5ceb352d1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:05.579865 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242d2468-b26c-4bdf-a6ca-5ceb352d1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bb366f-0d1b-41fd-8cd8-851b3606d4a4', 'volume_name': 'volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:05.613680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fa15f5-aefd-45f4-b399-51f220836a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:05.613680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fa15f5-aefd-45f4-b399-51f220836a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:05.613680 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b9a152-a1a6-4d7c-a8b2-9ea59d1c6a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:05.613680 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Volume 89bb366f-0d1b-41fd-8cd8-851b3606d4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4', 'volume_size': 1}
Jan 25 13:30:05.628361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:05.704480 n-d-760454-3 sudo[128863]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:30:05.718488 n-d-760454-3 sudo[128863]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:06.011163 n-d-760454-3 sudo[128834]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:06.028423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.372s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:06.028423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:06.069326 n-d-760454-3 sudo[128872]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:30:06.070960 n-d-760454-3 sudo[128872]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:07.575347 n-d-760454-3 sudo[128863]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:07.578398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.959s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:07.582755 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b9a152-a1a6-4d7c-a8b2-9ea59d1c6a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:07.586030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fbb25b-8865-4e8f-a92b-12f15443ca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:07.647109 n-d-760454-3 sudo[128872]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:07.651062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.633s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:07.656340 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:30:07.688597 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Deleted volume successfully.
Jan 25 13:30:07.736934 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Volume volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 (89bb366f-0d1b-41fd-8cd8-851b3606d4a4): created successfully
Jan 25 13:30:07.743153 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fbb25b-8865-4e8f-a92b-12f15443ca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:07.752778 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (85daca78-588b-4faa-b22e-946a2153df73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:07.809288 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-22f8fa38-acd3-4d36-beed-5bc919fc103e tempest-VolumesBackupsAdminTest-1175234813 None] Lock "b'cinder-4de584c6-296c-4731-a230-55cc1a91159e-delete_volume'" released by "delete_volume" :: held 6.736s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:30:07.843412 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-70267eeb-a4a3-4189-84c1-fc2d2af7690a tempest-VolumesBackupsTest-1355027314 None] Created volume successfully.
Jan 25 13:30:20.322359 n-d-760454-3 sudo[128601]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:20.325289 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3" returned: 0 in 27.881s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:20.327513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:20.595771 n-d-760454-3 sudo[129113]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1
Jan 25 13:30:20.596322 n-d-760454-3 sudo[129113]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:21.591196 n-d-760454-3 sudo[129113]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:21.594349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1" returned: 0 in 1.266s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:21.596568 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmp7kstm_9yn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 27.88 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--3dc93aa0--a860--44bb--a7b0--8b5d9f08aac3 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:30:21.597203 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Converted 700.00 MB image at 25.10 MB/s
Jan 25 13:30:21.598524 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:30:21.810800 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user e4fb5ea020004e8f99712ef8d9fe0736 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:30:21.811852 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Marking volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:30:21.885607 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:30:21.886079 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Creating volume glance metadata for volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:30:22.230280 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:30:22.236296 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:30:22.237151 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:30:22.253454 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Flow 'volume_create_manager' (99f402c0-d579-4961-ba91-afc9f3280153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:22.302498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aca056-7358-4b9e-a20f-8e28285eee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.350446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:30:22.399375 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98aca056-7358-4b9e-a20f-8e28285eee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1675315374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=746a97bb-bf68-4a1d-a521-b96d5a120aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68690c5b8b56498c846aee54564c4bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:30:22Z,user_id='9b51c966854c4ecea0cf429c1d0f21ac',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.404668 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00dee01-ab09-4d09-9b6d-cd9740ec7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.411390 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00dee01-ab09-4d09-9b6d-cd9740ec7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.416197 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57629ec6-8594-438c-9745-a358cf01d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.420754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57629ec6-8594-438c-9745-a358cf01d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746a97bb-bf68-4a1d-a521-b96d5a120aff', 'volume_name': 'volume-746a97bb-bf68-4a1d-a521-b96d5a120aff', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.424383 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc2aaa-e728-4cf4-8495-82fa01636a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.427552 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc2aaa-e728-4cf4-8495-82fa01636a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.431851 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26291d19-ba0b-4ea9-a37f-a77805574e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.433322 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Volume 746a97bb-bf68-4a1d-a521-b96d5a120aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746a97bb-bf68-4a1d-a521-b96d5a120aff', 'volume_size': 1}
Jan 25 13:30:22.434734 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-746a97bb-bf68-4a1d-a521-b96d5a120aff stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:22.484376 n-d-760454-3 sudo[129179]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-746a97bb-bf68-4a1d-a521-b96d5a120aff stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:30:22.501244 n-d-760454-3 sudo[129179]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:22.516066 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a17e8a-9542-43d7-85bf-2a3208c73c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c3b9c50>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.519329 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6a02b0-954a-4ee9-95c4-9b14f9c7171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:22.576136 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Volume volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 (3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3): created successfully
Jan 25 13:30:22.579157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6a02b0-954a-4ee9-95c4-9b14f9c7171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:22.583917 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (e956dae2-2c8c-4ff3-bb7f-1b1d63803ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:22.657632 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c7805b15-ee43-46a8-ab1b-f7fcbbb8f79b tempest-VolumesCloneTest-1384014301 None] Created volume successfully.
Jan 25 13:30:23.557607 n-d-760454-3 sudo[129179]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:23.559666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-746a97bb-bf68-4a1d-a521-b96d5a120aff stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.125s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:23.562280 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26291d19-ba0b-4ea9-a37f-a77805574e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746a97bb-bf68-4a1d-a521-b96d5a120aff', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:23.566630 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba4a955-51a5-4dea-b7d7-7ca71ce04c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:23.639169 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Volume volume-746a97bb-bf68-4a1d-a521-b96d5a120aff (746a97bb-bf68-4a1d-a521-b96d5a120aff): created successfully
Jan 25 13:30:23.641951 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba4a955-51a5-4dea-b7d7-7ca71ce04c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:23.645844 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Flow 'volume_create_manager' (99f402c0-d579-4961-ba91-afc9f3280153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:23.713274 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5aeb004e-da99-46b0-b4c5-d387aea7599f tempest-VolumesBackupsV39Test-240834003 None] Created volume successfully.
Jan 25 13:30:25.342855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:30:25.349852 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:30:25.350412 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:30:25.387694 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (2f3274af-75e0-47da-a1df-2151cac9c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:25.392266 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eccdbe3-a2d9-499a-981d-570b2cf10d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:25.425070 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:30:25.457436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eccdbe3-a2d9-499a-981d-570b2cf10d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-527350414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=32e50ddd-85cd-44c5-926c-aee7275104ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc05b9d4e53d453f86824a61b65052a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3,status='creating',terminated_at=None,updated_at=2021-01-25T13:30:25Z,user_id='e4fb5ea020004e8f99712ef8d9fe0736',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:25.461135 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d015e9d-8d33-446e-a67c-1410e6c2dfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:25.464317 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d015e9d-8d33-446e-a67c-1410e6c2dfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:25.467796 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b6d89c-fb22-4fb9-ab59-50403396e935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:25.530009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b6d89c-fb22-4fb9-ab59-50403396e935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '32e50ddd-85cd-44c5-926c-aee7275104ba', 'volume_name': 'volume-32e50ddd-85cd-44c5-926c-aee7275104ba', 'volume_size': 1, 'source_volid': '3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:25.532983 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df4644-9044-46d4-a038-f47607d3210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:25.535586 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df4644-9044-46d4-a038-f47607d3210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:25.538594 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd500072-f414-4fa3-8ea5-b58061de48c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:25.539760 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Volume 32e50ddd-85cd-44c5-926c-aee7275104ba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-32e50ddd-85cd-44c5-926c-aee7275104ba', 'volume_size': 1, 'source_volid': '3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'source_volstatus': 'available'}
Jan 25 13:30:25.596578 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Creating clone of volume: 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:30:25.597811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:25.655956 n-d-760454-3 sudo[129266]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:30:25.656578 n-d-760454-3 sudo[129266]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:26.226240 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Creating a new backup for volume volume-746a97bb-bf68-4a1d-a521-b96d5a120aff. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:30:26.241349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:26.282481 n-d-760454-3 sudo[129274]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:26.283373 n-d-760454-3 sudo[129274]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:26.671859 n-d-760454-3 sudo[129266]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:26.674365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3" returned: 0 in 1.076s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:26.675508 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba --snapshot stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:26.710590 n-d-760454-3 sudo[129280]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba --snapshot stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 -L 1.00g
Jan 25 13:30:26.714904 n-d-760454-3 sudo[129280]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:27.138183 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:30:27.144055 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:30:27.144958 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:30:27.178651 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (c46ac4a2-023a-4606-bfc7-e9ed83be4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:27.197438 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d95a13d-f7a3-4eb7-96c6-7983d30a16b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:27.219677 n-d-760454-3 sudo[129274]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:27.254459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff" returned: 0 in 1.011s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:27.286161 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:30:27.333813 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d95a13d-f7a3-4eb7-96c6-7983d30a16b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-836633836',ec2_id=None,encryption_key_id=00000000-0000-0000-0000-000000000000,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=da06acf8-8671-482f-9bd2-387a810ed116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:30:27Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(44c2a7ae-3af6-4e52-9128-f64d3a42e6d9),volume_type_id=44c2a7ae-3af6-4e52-9128-f64d3a42e6d9)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:27.337308 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733b3f07-6252-45fc-9b5f-fa3170e10629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:27.339908 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733b3f07-6252-45fc-9b5f-fa3170e10629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:27.343409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52404b99-df2c-4003-89e2-5da862aa5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:27.346033 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52404b99-df2c-4003-89e2-5da862aa5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da06acf8-8671-482f-9bd2-387a810ed116', 'volume_name': 'volume-da06acf8-8671-482f-9bd2-387a810ed116', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:27.349245 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c529fab1-81f8-4507-a675-1351a89060ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:27.352140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c529fab1-81f8-4507-a675-1351a89060ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:27.355695 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e2c7f-f7dc-45da-870a-2bd5b2301c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:27.356939 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Volume da06acf8-8671-482f-9bd2-387a810ed116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da06acf8-8671-482f-9bd2-387a810ed116', 'volume_size': 1}
Jan 25 13:30:27.358484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-da06acf8-8671-482f-9bd2-387a810ed116 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:27.392882 n-d-760454-3 sudo[129286]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-da06acf8-8671-482f-9bd2-387a810ed116 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:30:27.394078 n-d-760454-3 sudo[129286]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:27.405071 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:27.411250 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.008s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:27.411551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:27.412509 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:30:27.413573 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Creating iscsi_target for Volume ID: volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Created volume path /opt/stack/data/cinder/volumes/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff,
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff>
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:     incominguser CPLpX47M3ZdtVuKQvddE rWEybaj9T7FSDrz2
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:30:27.489311 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:30:27.493173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:27.973635 n-d-760454-3 sudo[129280]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:27.975527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba --snapshot stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 -L 1.00g" returned: 0 in 1.300s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:27.977226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32e50ddd-85cd-44c5-926c-aee7275104ba stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:28.033622 n-d-760454-3 sudo[129393]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32e50ddd-85cd-44c5-926c-aee7275104ba stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:30:28.036277 n-d-760454-3 sudo[129393]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:28.432765 n-d-760454-3 sudo[129286]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:28.435652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-da06acf8-8671-482f-9bd2-387a810ed116 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.077s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:28.450972 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77e2c7f-f7dc-45da-870a-2bd5b2301c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da06acf8-8671-482f-9bd2-387a810ed116', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:28.459480 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe3be55-5618-42a5-ad9e-3b3dd2314646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:30:28.531012 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-da06acf8-8671-482f-9bd2-387a810ed116 (da06acf8-8671-482f-9bd2-387a810ed116): created successfully
Jan 25 13:30:28.533178 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe3be55-5618-42a5-ad9e-3b3dd2314646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:30:28.537666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (c46ac4a2-023a-4606-bfc7-e9ed83be4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:30:28.549157 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff" returned: 0 in 1.038s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:28.549653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:28.550491 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:30:28.556220 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:30:28.558740 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:28.590758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.032s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:28.591295 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:28.592014 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:30:28.595221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:28.596785 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-542722eb-4058-4bd2-a849-03d9d77cc4e7 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:30:28.827147 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.234s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:28.827488 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:28.834909 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:29.081061 n-d-760454-3 sudo[129393]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:29.083559 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-32e50ddd-85cd-44c5-926c-aee7275104ba stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.106s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:29.086959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:29.132220 n-d-760454-3 sudo[129485]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:30:29.134386 n-d-760454-3 sudo[129485]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:29.179366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.350s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:29.180100 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:29.182083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:30:29.297945 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Initialize volume connection completed successfully.
Jan 25 13:30:29.727598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 0.632s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:29.727598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:29.717241 n-d-760454-3 sudo[129485]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:29.783045 n-d-760454-3 sudo[129516]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba iflag=direct
Jan 25 13:30:29.783664 n-d-760454-3 sudo[129516]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:30.433886 n-d-760454-3 sudo[129516]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:30.436805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba iflag=direct" returned: 0 in 0.715s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:30.438295 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:30.477622 n-d-760454-3 sudo[129547]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba oflag=direct
Jan 25 13:30:30.478191 n-d-760454-3 sudo[129547]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:31.101717 n-d-760454-3 sudo[129547]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:31.105101 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba oflag=direct" returned: 0 in 0.666s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:31.106294 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:31.148036 n-d-760454-3 sudo[129559]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:30:31.159504 n-d-760454-3 sudo[129559]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:35.971037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:30:35.971729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:30:35.972445 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:36.079118 n-d-760454-3 sudo[129618]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:30:36.083222 n-d-760454-3 sudo[129618]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:36.922936 n-d-760454-3 sudo[129618]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:36.925333 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.953s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:36.926936 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:37.086681 n-d-760454-3 sudo[129667]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:30:37.087574 n-d-760454-3 sudo[129667]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:38.598446 n-d-760454-3 sudo[129667]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:38.613423 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.673s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:38.613423 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:30:44.433084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:44.497438 n-d-760454-3 sudo[129818]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:30:44.498754 n-d-760454-3 sudo[129818]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:30:45.105004 n-d-760454-3 sudo[129818]: pam_unix(sudo:session): session closed for user root
Jan 25 13:30:45.108723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116" returned: 0 in 0.674s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:45.217622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:45.222847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.025s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:45.228980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:30:45.230292 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:30:45.252486 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-da06acf8-8671-482f-9bd2-387a810ed116,
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116>
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:     incominguser 3289yAW9487b25SkuGan Dsz99V9pKaZ2zYmm
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:30:45.372938 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:30:45.408956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:46.311014 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116" returned: 0 in 0.936s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:46.311793 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:46.312735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:30:46.313666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:30:46.319474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:46.338992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.021s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:46.339800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:30:46.341384 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:30:46.371458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:46.476132 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.119s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:46.476862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:46.479695 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:30:46.695660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.215s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:30:46.696752 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:30:46.698786 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:30:47.915358 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-797f46ad-25c3-485d-a447-9f3fc2e527fd req-ebf084de-d8c1-4a19-9d8b-2e87ea6dfd85 tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:31:00.754101 n-d-760454-3 sudo[129559]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:00.757486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba of=/dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 29.651s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:00.762242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-clone--snap--32e50ddd--85cd--44c5--926c--aee7275104ba, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--32e50ddd--85cd--44c5--926c--aee7275104ba, size 1024.00 MB, duration 29.66 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:31:00.769539 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Volume copy 1024.00 MB at 34.53 MB/s
Jan 25 13:31:00.771601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:00.843529 n-d-760454-3 sudo[129960]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:00.849196 n-d-760454-3 sudo[129960]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:01.954044 n-d-760454-3 sudo[129960]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:01.956371 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 1.185s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:01.958697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:02.012797 n-d-760454-3 sudo[129964]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:02.017474 n-d-760454-3 sudo[129964]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:03.140104 n-d-760454-3 sudo[129964]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:03.144283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 1.184s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:03.148096 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Marking volume 32e50ddd-85cd-44c5-926c-aee7275104ba as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:31:03.214723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Copying metadata from source volume 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 to 32e50ddd-85cd-44c5-926c-aee7275104ba. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Jan 25 13:31:03.337752 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:03.379104 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd500072-f414-4fa3-8ea5-b58061de48c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e50ddd-85cd-44c5-926c-aee7275104ba', 'volume_size': 1, 'source_volid': '3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:03.380185 n-d-760454-3 sudo[130005]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:03.380769 n-d-760454-3 sudo[130005]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:03.382206 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10b00af-2b97-4893-b531-1b679e465192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:03.456890 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Volume volume-32e50ddd-85cd-44c5-926c-aee7275104ba (32e50ddd-85cd-44c5-926c-aee7275104ba): created successfully
Jan 25 13:31:03.456890 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10b00af-2b97-4893-b531-1b679e465192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:03.461592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (2f3274af-75e0-47da-a1df-2151cac9c794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:03.537789 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e6589ef2-b0e8-446f-a94a-f0cca1c822e0 tempest-VolumesCloneTest-1384014301 None] Created volume successfully.
Jan 25 13:31:04.256795 n-d-760454-3 sudo[130005]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:04.260194 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 0.928s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:04.377445 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:04.414499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.039s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:04.414942 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 30\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 30
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         3289yAW9487b25SkuGan
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:04.416571 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:31:04.424308 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4,
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4>
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:     incominguser VeivRKNZdzrJH7WJ7H6y e45TUHLkUS3bUcYY
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:31:04.534554 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:31:04.538562 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:05.489489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 0.951s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:05.490302 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:05.490580 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:31:05.491164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:31:05.494730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:05.529376 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.036s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:05.531239 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 30\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]: Target 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 30
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         3289yAW9487b25SkuGan
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:05.532266 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:31:05.545811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:05.736858 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.194s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:05.737774 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 30\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:05.743457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:06.051983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.311s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:06.052807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 30\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:06.054230 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:31:06.655682 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:31:06.684207 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:31:06.685393 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:31:06.718615 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (5687c799-5a72-4179-8847-4b3f89d568ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:06.731739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96686ec6-cce4-4e63-b198-59c1a4f7325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:06.836957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:31:06.926463 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96686ec6-cce4-4e63-b198-59c1a4f7325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2016395528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=1e4fa742-fac2-41bd-ac18-7c679253899b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc05b9d4e53d453f86824a61b65052a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:31:06Z,user_id='e4fb5ea020004e8f99712ef8d9fe0736',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:06.933036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b289299-44b2-4a7a-9e66-53b8a725da48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:06.936669 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b289299-44b2-4a7a-9e66-53b8a725da48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:06.940298 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9589b95-4dd1-40a7-bd1d-fda62dbfc48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:06.945015 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9589b95-4dd1-40a7-bd1d-fda62dbfc48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4fa742-fac2-41bd-ac18-7c679253899b', 'volume_name': 'volume-1e4fa742-fac2-41bd-ac18-7c679253899b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:06.950010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a8a36-de01-40ea-aeae-47547e67b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:06.954189 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124a8a36-de01-40ea-aeae-47547e67b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:06.958820 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a81500b-348f-4d3b-99d6-d5240fdbb458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:06.960125 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Volume 1e4fa742-fac2-41bd-ac18-7c679253899b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4fa742-fac2-41bd-ac18-7c679253899b', 'volume_size': 1}
Jan 25 13:31:06.963992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1e4fa742-fac2-41bd-ac18-7c679253899b stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:06.997434 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-91949335-d02b-4801-b72d-2c500a409882 req-67d1e1d2-37c3-4a56-bc11-8b95213737a6 tempest-VolumesBackupsTest-1355027314 None] attachment_update completed successfully.
Jan 25 13:31:07.000682 n-d-760454-3 sudo[130074]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1e4fa742-fac2-41bd-ac18-7c679253899b stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:31:07.001358 n-d-760454-3 sudo[130074]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:08.042759 n-d-760454-3 sudo[130074]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:08.045594 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1e4fa742-fac2-41bd-ac18-7c679253899b stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.084s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:08.048773 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a81500b-348f-4d3b-99d6-d5240fdbb458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4fa742-fac2-41bd-ac18-7c679253899b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:08.051337 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7202755-26cc-48cd-b4a0-53835ac405bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:08.111770 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Volume volume-1e4fa742-fac2-41bd-ac18-7c679253899b (1e4fa742-fac2-41bd-ac18-7c679253899b): created successfully
Jan 25 13:31:08.114073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7202755-26cc-48cd-b4a0-53835ac405bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:08.118424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (5687c799-5a72-4179-8847-4b3f89d568ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:08.198350 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-202dad61-cc21-49bb-9cf7-5ee409d36bac tempest-VolumesCloneTest-1384014301 None] Created volume successfully.
Jan 25 13:31:11.153582 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:31:11.181645 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:31:11.182593 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:31:11.259234 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (5a9b65e8-7a84-4000-a4e2-9a8a4375d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:11.265702 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a206557d-6843-4574-b512-61e5b46314d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:11.304329 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:31:11.361772 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a206557d-6843-4574-b512-61e5b46314d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-608631051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=0bddcd43-4663-42c1-b3e9-f4ac38372e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc05b9d4e53d453f86824a61b65052a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:31:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=1e4fa742-fac2-41bd-ac18-7c679253899b,status='creating',terminated_at=None,updated_at=2021-01-25T13:31:11Z,user_id='e4fb5ea020004e8f99712ef8d9fe0736',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:11.367188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa0ad7e-84b9-4f11-9540-08f797523243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:11.373036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa0ad7e-84b9-4f11-9540-08f797523243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:11.376221 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a359f8-b0aa-4209-9f10-52afde248d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:11.468452 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a359f8-b0aa-4209-9f10-52afde248d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0bddcd43-4663-42c1-b3e9-f4ac38372e93', 'volume_name': 'volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93', 'volume_size': 2, 'source_volid': '1e4fa742-fac2-41bd-ac18-7c679253899b', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:11.474418 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1337f894-f944-4a9e-a750-5e301c10e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:11.479852 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1337f894-f944-4a9e-a750-5e301c10e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:11.486493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83e23e5-317a-4b3c-8611-2e0c6afd4b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:11.488460 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Volume 0bddcd43-4663-42c1-b3e9-f4ac38372e93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93', 'volume_size': 2, 'source_volid': '1e4fa742-fac2-41bd-ac18-7c679253899b', 'source_volstatus': 'available'}
Jan 25 13:31:11.559233 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Creating clone of volume: 1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:11.561635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:11.619298 n-d-760454-3 sudo[130140]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:11.622891 n-d-760454-3 sudo[130140]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:12.537738 n-d-760454-3 sudo[130140]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:12.540923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b" returned: 0 in 0.978s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:12.542525 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 --snapshot stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:12.595898 n-d-760454-3 sudo[130144]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 --snapshot stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b -L 1.00g
Jan 25 13:31:12.597304 n-d-760454-3 sudo[130144]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:14.384046 n-d-760454-3 sudo[130144]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:14.386839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 --snapshot stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b -L 1.00g" returned: 0 in 1.844s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:14.389396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 stack-volumes-lvmdriver-1 -L 2g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:14.457469 n-d-760454-3 sudo[130243]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 stack-volumes-lvmdriver-1 -L 2g
Jan 25 13:31:14.458354 n-d-760454-3 sudo[130243]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:15.879747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Creating a new backup for volume volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:31:15.973600 n-d-760454-3 sudo[130243]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:15.975830 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 stack-volumes-lvmdriver-1 -L 2g" returned: 0 in 1.586s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:15.978665 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:16.032143 n-d-760454-3 sudo[130278]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:16.037740 n-d-760454-3 sudo[130278]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:16.169676 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Creating clone of volume: 89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:16.172356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:16.239795 n-d-760454-3 sudo[130280]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:16.247688 n-d-760454-3 sudo[130280]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:17.111332 n-d-760454-3 sudo[130278]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:17.117118 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 1.137s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:17.123190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:17.153207 n-d-760454-3 sudo[130284]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 iflag=direct
Jan 25 13:31:17.155099 n-d-760454-3 sudo[130284]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:17.554590 n-d-760454-3 sudo[130280]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:17.558853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 1.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:17.561062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 --snapshot stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:17.650751 n-d-760454-3 sudo[130288]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 --snapshot stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 -L 1.00g
Jan 25 13:31:17.656046 n-d-760454-3 sudo[130288]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:18.066730 n-d-760454-3 sudo[130284]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:18.070339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 iflag=direct" returned: 0 in 0.947s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:18.072965 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:18.134983 n-d-760454-3 sudo[130298]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 oflag=direct
Jan 25 13:31:18.136108 n-d-760454-3 sudo[130298]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:19.225740 n-d-760454-3 sudo[130298]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:19.230923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 oflag=direct" returned: 0 in 1.158s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:19.237366 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:19.303561 n-d-760454-3 sudo[130382]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:31:19.305136 n-d-760454-3 sudo[130382]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:19.421303 n-d-760454-3 sudo[130288]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:19.425188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 --snapshot stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 -L 1.00g" returned: 0 in 1.864s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:19.427145 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46cff428-2603-434d-8020-70bf7b4b4182 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:19.474637 n-d-760454-3 sudo[130404]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46cff428-2603-434d-8020-70bf7b4b4182 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:31:19.475204 n-d-760454-3 sudo[130404]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:20.671613 n-d-760454-3 sudo[130404]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:20.674464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-46cff428-2603-434d-8020-70bf7b4b4182 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.247s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:20.677221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:20.702048 n-d-760454-3 sudo[130434]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:31:20.702944 n-d-760454-3 sudo[130434]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:21.553935 n-d-760454-3 sudo[130434]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:21.556809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 0.880s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:21.559199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:21.606656 n-d-760454-3 sudo[130439]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 iflag=direct
Jan 25 13:31:21.609211 n-d-760454-3 sudo[130439]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:22.330178 n-d-760454-3 sudo[130439]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:22.333605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 iflag=direct" returned: 0 in 0.773s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:22.335358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:22.368460 n-d-760454-3 sudo[130474]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 oflag=direct
Jan 25 13:31:22.369795 n-d-760454-3 sudo[130474]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:22.949030 n-d-760454-3 sudo[130474]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:22.951832 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 oflag=direct" returned: 0 in 0.616s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:22.953399 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:23.001806 n-d-760454-3 sudo[130486]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:31:23.013092 n-d-760454-3 sudo[130486]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:31.160328 n-d-760454-3 sudo[130382]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:31.162653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 11.930s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:31.163325 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-clone--snap--0bddcd43--4663--42c1--b3e9--f4ac38372e93, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--0bddcd43--4663--42c1--b3e9--f4ac38372e93, size 1024.00 MB, duration 11.93 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:31:31.164259 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Volume copy 1024.00 MB at 85.82 MB/s
Jan 25 13:31:31.165256 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:31.182711 n-d-760454-3 sudo[130569]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:31.183315 n-d-760454-3 sudo[130569]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:32.028759 n-d-760454-3 sudo[130569]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:32.031822 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 0.866s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:32.035244 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:32.074826 n-d-760454-3 sudo[130578]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:32.075543 n-d-760454-3 sudo[130578]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:33.237812 n-d-760454-3 sudo[130578]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:33.251873 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 1.212s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:33.261194 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83e23e5-317a-4b3c-8611-2e0c6afd4b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93', 'volume_size': 2, 'source_volid': '1e4fa742-fac2-41bd-ac18-7c679253899b', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:33.261194 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce4307-338c-43d4-8c78-d89b4d606dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:33.372667 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Volume volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 (0bddcd43-4663-42c1-b3e9-f4ac38372e93): created successfully
Jan 25 13:31:33.375699 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edce4307-338c-43d4-8c78-d89b4d606dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:33.381066 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Flow 'volume_create_manager' (5a9b65e8-7a84-4000-a4e2-9a8a4375d9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:33.481309 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a390b185-1e7a-4deb-ba5f-85e72c20de75 tempest-VolumesCloneTest-1384014301 None] Created volume successfully.
Jan 25 13:31:33.703759 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-13c96ac6-526d-4fa0-a2de-0458e65ff818 req-748e9e90-cb20-4a23-a393-f55de8723266 tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:31:33.704216 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-13c96ac6-526d-4fa0-a2de-0458e65ff818 req-748e9e90-cb20-4a23-a393-f55de8723266 tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 790458ac-29ac-406a-8cb5-32b1c4d5f459. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:31:33.734056 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:33.977198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.270s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:33.977570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116\n            Backing store flags: \n    Account information:\n        3289yAW9487b25SkuGan\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:33.978347 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-13c96ac6-526d-4fa0-a2de-0458e65ff818 req-748e9e90-cb20-4a23-a393-f55de8723266 tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:33.981749 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:34.353930 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-da06acf8-8671-482f-9bd2-387a810ed116 -f" returned: 0 in 0.373s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:34.354970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:34.356862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:34.505020 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.148s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:34.505758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700515486912]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:34.543368 n-d-760454-3 sudo[130486]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:34.612136 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 11.659s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:34.613191 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-clone--snap--46cff428--2603--434d--8020--70bf7b4b4182, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--46cff428--2603--434d--8020--70bf7b4b4182, size 1024.00 MB, duration 11.66 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:31:34.613832 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Volume copy 1024.00 MB at 87.82 MB/s
Jan 25 13:31:34.614952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:34.645561 n-d-760454-3 sudo[130642]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:31:34.650634 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-13c96ac6-526d-4fa0-a2de-0458e65ff818 req-748e9e90-cb20-4a23-a393-f55de8723266 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:34.650634 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:34.650634 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:34.653049 n-d-760454-3 sudo[130642]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:34.983261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-0bddcd43-4663-42c1-b3e9-f4ac38372e93-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:31:35.102096 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Skipping remove_export. No iscsi_target is presently exported for volume: 0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:35.105867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:35.168216 n-d-760454-3 sudo[130644]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:35.180863 n-d-760454-3 sudo[130644]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:35.859459 n-d-760454-3 sudo[130642]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:35.862349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 1.246s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:35.863741 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:35.938004 n-d-760454-3 sudo[130665]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:31:35.938698 n-d-760454-3 sudo[130665]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:35.976672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:31:35.978307 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:35.979368 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:36.047622 n-d-760454-3 sudo[130669]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:36.057516 n-d-760454-3 sudo[130669]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:36.156277 n-d-760454-3 sudo[130644]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:36.158731 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 1.052s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:36.159973 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:36.200857 n-d-760454-3 sudo[130674]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:36.204507 n-d-760454-3 sudo[130674]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:36.695798 n-d-760454-3 sudo[130669]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:36.697918 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:36.699571 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:36.745683 n-d-760454-3 sudo[130688]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:36.746822 n-d-760454-3 sudo[130688]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:37.193223 n-d-760454-3 sudo[130665]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:37.196387 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 1.332s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:37.248254 n-d-760454-3 sudo[130674]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:37.267800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 1.108s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:37.295422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:37.341534 n-d-760454-3 sudo[130742]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:37.342226 n-d-760454-3 sudo[130742]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:37.396574 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:37.447051 n-d-760454-3 sudo[130744]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:31:37.448006 n-d-760454-3 sudo[130744]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:37.905020 n-d-760454-3 sudo[130688]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:37.908464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.209s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:37.910274 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:38.076798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-da06acf8-8671-482f-9bd2-387a810ed116-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:31:38.185888 n-d-760454-3 sudo[130744]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:38.216739 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 0.820s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:38.327893 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:38.333336 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:38.345206 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.017s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:38.345833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 31
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         VeivRKNZdzrJH7WJ7H6y
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:38.346587 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:31:38.362260 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-46cff428-2603-434d-8020-70bf7b4b4182,
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182>
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:     incominguser 4veB76EGVftMsGDk5M8E FV3vkWqDRoR76uaW
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:31:38.442025 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:31:38.446280 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:38.474042 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.142s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:38.474612 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513354712]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:38.475656 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:38.476799 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:38.497961 n-d-760454-3 sudo[130761]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:38.499390 n-d-760454-3 sudo[130761]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:38.531486 n-d-760454-3 sudo[130742]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:38.534554 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-0bddcd43-4663-42c1-b3e9-f4ac38372e93" returned: 0 in 1.245s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:38.536086 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Successfully deleted volume: 0bddcd43-4663-42c1-b3e9-f4ac38372e93
Jan 25 13:31:38.647528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Created reservations ['61e9f1e4-156b-4ec3-9276-4ee05d4d0899', '7e04e50f-66a7-414a-99ed-55a7bf293120', '6da5a4e1-59a8-46b1-8baa-e832068df307', '1906d167-5b3d-4987-9f80-154bc93ed3d5'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:31:38.650990 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:38.650990 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:38.650990 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:38.795525 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:38.796246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:38.839393 n-d-760454-3 sudo[130770]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:38.841456 n-d-760454-3 sudo[130770]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:39.184360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-1e4fa742-fac2-41bd-ac18-7c679253899b-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:31:39.370772 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Skipping remove_export. No iscsi_target is presently exported for volume: 1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:39.371883 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:39.478985 n-d-760454-3 sudo[130787]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:39.480125 n-d-760454-3 sudo[130787]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:39.515505 n-d-760454-3 sudo[130761]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:39.518051 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116" returned: 0 in 1.041s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:39.519282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:39.599453 n-d-760454-3 sudo[130790]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:39.600825 n-d-760454-3 sudo[130790]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:39.618032 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 1.172s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:39.619155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:39.621208 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:31:39.621853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:31:39.624010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:39.683091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.059s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:39.683762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 29
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         CPLpX47M3ZdtVuKQvddE
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 31
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         VeivRKNZdzrJH7WJ7H6y
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:31:39.684784 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:31:39.695180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:39.726773 n-d-760454-3 sudo[130770]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:39.728897 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.933s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:39.730824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:39.816933 n-d-760454-3 sudo[130821]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:39.817863 n-d-760454-3 sudo[130821]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:40.040085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.339s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:40.040085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:40.040085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:40.354823 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.316s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:40.355522 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 29\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:31:40.358252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,4 iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:31:40.434120 n-d-760454-3 sudo[130787]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:40.449168 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b" returned: 0 in 1.077s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:40.450230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:40.483825 n-d-760454-3 sudo[130843]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:40.484405 n-d-760454-3 sudo[130843]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:40.493370 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Initialize volume connection completed successfully.
Jan 25 13:31:40.521303 n-d-760454-3 sudo[130790]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:40.523845 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116" returned: 0 in 1.005s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:40.526260 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:40.554655 n-d-760454-3 sudo[130846]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:40.555731 n-d-760454-3 sudo[130846]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:40.744915 n-d-760454-3 sudo[130821]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:40.748116 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.016s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:40.760874 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:40.764978 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Deleted volume successfully.
Jan 25 13:31:40.838923 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9c6b6c86-234e-40d2-87ef-ffb243b8c701 tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-0bddcd43-4663-42c1-b3e9-f4ac38372e93-delete_volume'" released by "delete_volume" :: held 5.856s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:31:41.384657 n-d-760454-3 sudo[130843]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:41.386977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b" returned: 0 in 0.937s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:41.389872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:41.416615 n-d-760454-3 sudo[130892]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:41.417461 n-d-760454-3 sudo[130892]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:41.744350 n-d-760454-3 sudo[130846]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:41.747164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-da06acf8-8671-482f-9bd2-387a810ed116" returned: 0 in 1.220s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:41.749065 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: da06acf8-8671-482f-9bd2-387a810ed116
Jan 25 13:31:41.797738 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-luks-2117067057 is set by the default quota flag: quota_volumes_tempest-scenario-type-luks-2117067057, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:31:41.799640 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-luks-2117067057 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-luks-2117067057, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:31:41.860446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['2f2d942e-7c7b-4308-ae32-dc5932daa414', 'f63dc026-2acb-4a0c-8e0d-3a607df70da6', 'd08970b0-0597-4467-9327-20bcd8e975ad', '6330715d-570b-4310-a140-440ee08cf8c0'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:31:41.867008 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:41.867008 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:41.867008 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:42.111757 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:42.112461 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:42.182685 n-d-760454-3 sudo[130908]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:42.184354 n-d-760454-3 sudo[130908]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:42.187532 n-d-760454-3 sudo[130892]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:42.190970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1e4fa742-fac2-41bd-ac18-7c679253899b" returned: 0 in 0.801s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:42.192871 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Successfully deleted volume: 1e4fa742-fac2-41bd-ac18-7c679253899b
Jan 25 13:31:42.370758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Created reservations ['eaf2bc36-7eea-4ce0-bcbb-d4948cd27bed', 'f23f7b58-832a-42e5-a07d-aad487800d15', 'e8f3a0ba-ebd4-41fb-a5ba-27c1f9e6f4b9', 'c463e1c4-660c-40cc-8196-b30632721e67'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:31:42.395240 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:42.395240 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:42.395240 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:42.625880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:42.626833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:42.678196 n-d-760454-3 sudo[130913]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:42.680800 n-d-760454-3 sudo[130913]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:43.376565 n-d-760454-3 sudo[130908]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:43.380079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.267s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:43.392668 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:43.414793 n-d-760454-3 sudo[130920]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:43.415822 n-d-760454-3 sudo[130920]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:43.843766 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-32e50ddd-85cd-44c5-926c-aee7275104ba-delete_volume'" acquired by "delete_volume" :: waited 0.048s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:31:43.932376 n-d-760454-3 sudo[130913]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:43.934694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.308s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:43.936047 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:43.994597 n-d-760454-3 sudo[130925]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:44.003035 n-d-760454-3 sudo[130925]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:44.208262 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Skipping remove_export. No iscsi_target is presently exported for volume: 32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:44.213954 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:44.309573 n-d-760454-3 sudo[130927]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:44.310259 n-d-760454-3 sudo[130927]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:45.213962 n-d-760454-3 sudo[130920]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:45.216439 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.829s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:45.218316 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:45.226060 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:31:45.422494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-901aa216-cdbc-4c37-a074-0fbbb1030387 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-da06acf8-8671-482f-9bd2-387a810ed116-delete_volume'" released by "delete_volume" :: held 7.344s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:31:45.454032 n-d-760454-3 sudo[130925]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:45.462279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.520s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:45.462279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:45.463134 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Deleted volume successfully.
Jan 25 13:31:45.554433 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b4da8239-d61f-4736-9130-24146332bfea tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-1e4fa742-fac2-41bd-ac18-7c679253899b-delete_volume'" released by "delete_volume" :: held 6.370s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:31:45.586078 n-d-760454-3 sudo[130927]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:45.589022 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 1.375s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:45.590124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:45.628140 n-d-760454-3 sudo[130937]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:45.628746 n-d-760454-3 sudo[130937]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:45.875411 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:31:45.906702 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:31:45.918346 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:31:45.995324 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (87eea29d-5c67-4341-82ee-cc2637f5f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:31:45.999456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac10c53f-503e-4285-b24d-ef5ddf4f7568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:46.062884 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:31:46.136730 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac10c53f-503e-4285-b24d-ef5ddf4f7568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-373529526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=7b3f511f-6059-4b05-9869-3e4479a3bf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:31:46Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:46.147424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cbc3c0-6208-4e50-94be-9d051fa5895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:46.150272 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cbc3c0-6208-4e50-94be-9d051fa5895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:46.163013 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2622d4ad-c934-4d27-ad90-255bdc3e97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:46.247366 n-d-760454-3 sudo[130937]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:46.252638 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 0.662s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:46.254232 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:46.316746 n-d-760454-3 sudo[130941]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:46.317488 n-d-760454-3 sudo[130941]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:46.342875 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2622d4ad-c934-4d27-ad90-255bdc3e97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b3f511f-6059-4b05-9869-3e4479a3bf03', 'volume_name': 'volume-7b3f511f-6059-4b05-9869-3e4479a3bf03', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4be3c8>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:46.345729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f7798-908f-4534-bd32-30f58aa15354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:46.355536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f7798-908f-4534-bd32-30f58aa15354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:31:46.358433 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a1a5c5-bffd-42cc-900a-4405fd72e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:31:46.362388 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Volume 7b3f511f-6059-4b05-9869-3e4479a3bf03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b3f511f-6059-4b05-9869-3e4479a3bf03', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4be3c8>}
Jan 25 13:31:46.366802 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Cloning 7b3f511f-6059-4b05-9869-3e4479a3bf03 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:31:47.340905 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-32e50ddd-85cd-44c5-926c-aee7275104ba" returned: 0 in 1.076s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:47.340905 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Successfully deleted volume: 32e50ddd-85cd-44c5-926c-aee7275104ba
Jan 25 13:31:47.327271 n-d-760454-3 sudo[130941]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:47.473035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Created reservations ['5327e462-9e55-483a-a3a8-fe0198407185', 'cb1ae22f-16d4-45e7-8ab9-e94a8dd30013', '324b1f45-3df8-408c-8b6e-05da26cbcc76', '3426c2d3-28b4-4ee9-804a-e1b52899af24'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:31:47.475496 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:47.475496 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:47.475496 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:47.606918 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:47.607723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:47.656344 n-d-760454-3 sudo[130950]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:47.656977 n-d-760454-3 sudo[130950]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:48.319370 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3-delete_volume'" acquired by "delete_volume" :: waited 0.065s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:31:48.592058 n-d-760454-3 sudo[130950]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:48.658652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.051s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:48.703253 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:48.777333 n-d-760454-3 sudo[130954]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:48.778793 n-d-760454-3 sudo[130954]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:48.819932 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Skipping remove_export. No iscsi_target is presently exported for volume: 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:31:48.819932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:48.867125 n-d-760454-3 sudo[130956]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:31:48.872393 n-d-760454-3 sudo[130956]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:50.293475 n-d-760454-3 sudo[130956]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:50.297926 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3" returned: 0 in 1.489s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:50.300903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:50.337112 n-d-760454-3 sudo[130970]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:31:50.337795 n-d-760454-3 sudo[130970]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:50.362952 n-d-760454-3 sudo[130954]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:50.369228 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.675s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:50.386931 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:50.429595 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Deleted volume successfully.
Jan 25 13:31:50.504315 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-01c04aa4-45e7-4b0d-9d79-f1322e06b5f7 tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-32e50ddd-85cd-44c5-926c-aee7275104ba-delete_volume'" released by "delete_volume" :: held 6.663s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:31:51.134716 n-d-760454-3 sudo[130970]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:51.139174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3" returned: 0 in 0.837s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:51.141782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:51.178092 n-d-760454-3 sudo[130995]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:31:51.180380 n-d-760454-3 sudo[130995]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:52.036015 n-d-760454-3 sudo[130995]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:52.042002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3" returned: 0 in 0.896s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:52.045628 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Successfully deleted volume: 3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3
Jan 25 13:31:52.283468 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Created reservations ['cba9c92f-02e8-4f68-981b-898550198778', '845ac996-5231-4279-a62c-47c15f48c79d', '0e8000ca-8d15-42e6-a27b-0fdce4d67520', 'e115483a-ac40-4f41-9bfb-dc56fb897dc8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:31:52.289995 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:31:52.289995 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:31:52.289995 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:31:52.460218 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:31:52.461811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:52.515433 n-d-760454-3 sudo[131033]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:31:52.522502 n-d-760454-3 sudo[131033]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:53.578822 n-d-760454-3 sudo[131033]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:53.590211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.128s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:53.592509 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:31:53.637290 n-d-760454-3 sudo[131039]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:31:53.637929 n-d-760454-3 sudo[131039]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:31:54.852854 n-d-760454-3 sudo[131039]: pam_unix(sudo:session): session closed for user root
Jan 25 13:31:54.857767 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.265s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:31:54.861012 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:31:54.870159 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Deleted volume successfully.
Jan 25 13:31:54.940424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b9e0dbf1-9cea-47ad-adc7-81026f6e246a tempest-VolumesCloneTest-1384014301 None] Lock "b'cinder-3dc93aa0-a860-44bb-a7b0-8b5d9f08aac3-delete_volume'" released by "delete_volume" :: held 6.622s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:32:00.801267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:32:00.809565 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:32:00.810419 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:32:00.830598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (aeef4955-6254-407c-8e34-92420d91c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:00.838964 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdac8e7-9586-4c2c-a5b6-af297678c1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:00.920778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:32:00.981108 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdac8e7-9586-4c2c-a5b6-af297678c1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1739003821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=438be147-f942-49db-9273-0574ecb92801,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:32:01Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:00.984436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf008eb1-d3f4-468d-a22f-ec556b637cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:00.987132 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf008eb1-d3f4-468d-a22f-ec556b637cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:00.990188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300f94a6-4aaa-4f3e-931f-a768084e1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:00.993967 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300f94a6-4aaa-4f3e-931f-a768084e1406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438be147-f942-49db-9273-0574ecb92801', 'volume_name': 'volume-438be147-f942-49db-9273-0574ecb92801', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:00.996688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6113d-66af-412a-a326-e5426ddb932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:00.999212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea6113d-66af-412a-a326-e5426ddb932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:01.002824 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fe8c1f-ef32-4cf7-a2f8-3c455d7345e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:01.004005 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Volume 438be147-f942-49db-9273-0574ecb92801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438be147-f942-49db-9273-0574ecb92801', 'volume_size': 1}
Jan 25 13:32:01.005386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-438be147-f942-49db-9273-0574ecb92801 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:01.070425 n-d-760454-3 sudo[333]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-438be147-f942-49db-9273-0574ecb92801 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:01.074184 n-d-760454-3 sudo[333]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:02.330372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-438be147-f942-49db-9273-0574ecb92801 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.259s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:02.330372 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fe8c1f-ef32-4cf7-a2f8-3c455d7345e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438be147-f942-49db-9273-0574ecb92801', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:02.330372 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68d70d9-c45e-4264-a74b-349ab5ec307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:02.262475 n-d-760454-3 sudo[333]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:02.430357 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Volume volume-438be147-f942-49db-9273-0574ecb92801 (438be147-f942-49db-9273-0574ecb92801): created successfully
Jan 25 13:32:02.519076 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68d70d9-c45e-4264-a74b-349ab5ec307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:02.519076 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (aeef4955-6254-407c-8e34-92420d91c053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:03.402620 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-bf949b27-eb61-4133-a6a4-441bf8a4b75d tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:32:05.227794 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:32:05.235775 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:32:05.236263 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:32:05.297494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (814b5cfc-e7e0-4435-a2bd-d312db76d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:05.300914 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bc1a5b-f182-4734-9063-6266ea661bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:05.373190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:32:05.419706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bc1a5b-f182-4734-9063-6266ea661bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:32:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1978142057',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=2d508b5a-d179-4a19-be3c-8e978114f602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:32:05Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:05.424873 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35baff99-8872-4ee0-b5d8-4d97928bb276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:05.424873 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35baff99-8872-4ee0-b5d8-4d97928bb276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:05.429319 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1929650-6c7f-4e93-aa93-56d6759e3713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:05.430023 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1929650-6c7f-4e93-aa93-56d6759e3713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d508b5a-d179-4a19-be3c-8e978114f602', 'volume_name': 'volume-2d508b5a-d179-4a19-be3c-8e978114f602', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:05.432882 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee831bf-1596-423a-a6cc-4eec9addca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:05.435363 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee831bf-1596-423a-a6cc-4eec9addca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:05.437983 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83df57d7-5ba6-41f6-8ce5-f920a240f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:05.438830 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Volume 2d508b5a-d179-4a19-be3c-8e978114f602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d508b5a-d179-4a19-be3c-8e978114f602', 'volume_size': 1}
Jan 25 13:32:05.439955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2d508b5a-d179-4a19-be3c-8e978114f602 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:05.466826 n-d-760454-3 sudo[380]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2d508b5a-d179-4a19-be3c-8e978114f602 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:05.468340 n-d-760454-3 sudo[380]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:06.641513 n-d-760454-3 sudo[380]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:06.645427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2d508b5a-d179-4a19-be3c-8e978114f602 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.205s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:06.659589 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83df57d7-5ba6-41f6-8ce5-f920a240f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d508b5a-d179-4a19-be3c-8e978114f602', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:06.662219 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761372fb-d5c6-48a2-a513-be5eabf22478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:06.760381 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Volume volume-2d508b5a-d179-4a19-be3c-8e978114f602 (2d508b5a-d179-4a19-be3c-8e978114f602): created successfully
Jan 25 13:32:06.760381 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761372fb-d5c6-48a2-a513-be5eabf22478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:06.771056 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (814b5cfc-e7e0-4435-a2bd-d312db76d912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:06.844830 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a808e86f-4396-421b-967e-e921b5c724e8 tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:32:08.830558 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-2d508b5a-d179-4a19-be3c-8e978114f602-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:32:09.052941 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 2d508b5a-d179-4a19-be3c-8e978114f602
Jan 25 13:32:09.056225 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:09.137388 n-d-760454-3 sudo[456]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602
Jan 25 13:32:09.137941 n-d-760454-3 sudo[456]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:10.413308 n-d-760454-3 sudo[456]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:10.418892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602" returned: 0 in 1.362s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:10.421334 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:10.515986 n-d-760454-3 sudo[461]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602
Jan 25 13:32:10.516912 n-d-760454-3 sudo[461]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:11.627258 n-d-760454-3 sudo[461]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:11.631581 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602" returned: 0 in 1.210s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:11.639320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:11.696750 n-d-760454-3 sudo[467]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602
Jan 25 13:32:11.698117 n-d-760454-3 sudo[467]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:12.597519 n-d-760454-3 sudo[467]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:12.797111 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 26.43 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:32:12.797947 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Image download 616.00 MB at 23.31 MB/s
Jan 25 13:32:12.811904 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2d508b5a-d179-4a19-be3c-8e978114f602" returned: 0 in 1.173s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:12.851435 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 2d508b5a-d179-4a19-be3c-8e978114f602
Jan 25 13:32:12.900867 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Terminate volume connection completed successfully.
Jan 25 13:32:12.929486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:13.044238 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:13.109132 n-d-760454-3 sudo[494]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1
Jan 25 13:32:13.110447 n-d-760454-3 sudo[494]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:13.173420 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Created reservations ['cf5a035a-8c64-4a16-9571-aab5c472fbd4', '06c147ec-16ac-4185-9f16-2caeb7a1cecd', '44ffdec9-2b8c-44e9-ab4f-003bc79c559c', '8f68f19a-ec24-4c2e-9dc9-401a36ef0241'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:32:13.175764 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:32:13.175764 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:32:13.175764 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:32:13.247707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.207s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:13.248294 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356992]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff\n            Backing store flags: \n    Account information:\n        CPLpX47M3ZdtVuKQvddE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 32\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:32:13.249350 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Removing iscsi_target for Volume ID: 746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:13.250815 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:13.344729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:32:13.346155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:13.367633 n-d-760454-3 sudo[499]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:32:13.369037 n-d-760454-3 sudo[499]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:13.587506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-746a97bb-bf68-4a1d-a521-b96d5a120aff -f" returned: 0 in 0.332s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:13.588071 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356992]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:32:13.591396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:13.792645 n-d-760454-3 sudo[494]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:13.795065 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1" returned: 0 in 0.865s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:13.796471 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user e05ff2642a9b43da927aa763694ac642. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:32:13.838178 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.246s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:13.838706 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356992]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 32\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:32:13.839463 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-136081ab-b162-4fb4-b933-f3e8b1dc8673 tempest-VolumesBackupsV39Test-240834003 None] Remove volume export completed successfully.
Jan 25 13:32:13.988134 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:14.096741 n-d-760454-3 sudo[499]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:14.106744 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:14.106744 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:14.158263 n-d-760454-3 sudo[517]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:32:14.159868 n-d-760454-3 sudo[517]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:14.273531 n-d-760454-3 sudo[516]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1
Jan 25 13:32:14.280299 n-d-760454-3 sudo[516]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:14.314221 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-438be147-f942-49db-9273-0574ecb92801-delete_volume'" acquired by "delete_volume" :: waited 0.052s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:32:14.636678 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 438be147-f942-49db-9273-0574ecb92801
Jan 25 13:32:14.643036 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:14.705266 n-d-760454-3 sudo[520]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801
Jan 25 13:32:14.748333 n-d-760454-3 sudo[520]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:15.245459 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Lock "b'cinder-746a97bb-bf68-4a1d-a521-b96d5a120aff-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:32:15.312464 n-d-760454-3 sudo[516]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:15.362212 n-d-760454-3 sudo[517]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:15.509164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1" returned: 0 in 1.523s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:15.510222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.409s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:15.529443 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:15.560396 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:32:15.569124 n-d-760454-3 sudo[526]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:15.570171 n-d-760454-3 sudo[526]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:15.578738 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:32:15.610398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:15.659988 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-22da8d8c-0019-4ac9-902f-9b18ba7bf8f6 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-2d508b5a-d179-4a19-be3c-8e978114f602-delete_volume'" released by "delete_volume" :: held 6.829s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:32:15.858751 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.251s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:15.859299 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 32\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:32:15.860340 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Skipping remove_export. No iscsi_target is presently exported for volume: 746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:15.861385 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:15.932858 n-d-760454-3 sudo[520]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:15.950876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801" returned: 0 in 1.312s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:15.952806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:15.985044 n-d-760454-3 sudo[534]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:15.986513 n-d-760454-3 sudo[534]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:15.999693 n-d-760454-3 sudo[535]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801
Jan 25 13:32:16.008021 n-d-760454-3 sudo[535]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:16.780872 n-d-760454-3 sudo[526]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:16.783738 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.254s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:16.810899 n-d-760454-3 sudo[535]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:16.813246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801" returned: 0 in 0.861s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:16.815813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:16.837230 n-d-760454-3 sudo[571]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801
Jan 25 13:32:16.838453 n-d-760454-3 sudo[571]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:16.926412 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 7b3f511f-6059-4b05-9869-3e4479a3bf03. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:32:17.132568 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp9gujv0lo {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:17.241538 n-d-760454-3 sudo[534]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:17.246338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff" returned: 0 in 1.383s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:17.248417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:17.336174 n-d-760454-3 sudo[574]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:17.348406 n-d-760454-3 sudo[574]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:17.357433 n-d-760454-3 sudo[573]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp9gujv0lo
Jan 25 13:32:17.358992 n-d-760454-3 sudo[573]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:18.321781 n-d-760454-3 sudo[571]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:18.326659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-438be147-f942-49db-9273-0574ecb92801" returned: 0 in 1.509s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:18.327511 n-d-760454-3 sudo[573]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:18.327704 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 438be147-f942-49db-9273-0574ecb92801
Jan 25 13:32:18.386218 n-d-760454-3 sudo[574]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:18.394678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp9gujv0lo" returned: 0 in 1.262s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:18.396668 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:18.445724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff" returned: 0 in 1.196s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:18.451302 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:18.547969 n-d-760454-3 sudo[594]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:18.550649 n-d-760454-3 sudo[594]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:18.662577 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Created reservations ['12a71fc3-3686-41eb-adfc-af97ba13d132', '2c3f9d9d-2307-4d34-8f66-947f329b0f7d', 'f3b904cf-8496-4564-a007-5ac1a590eb5e', '059f8892-9a9e-4a85-b8c4-548da6f8649a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:32:18.663836 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:32:18.663836 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:32:18.663836 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:32:18.757744 n-d-760454-3 sudo[590]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1
Jan 25 13:32:18.768308 n-d-760454-3 sudo[590]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:18.957168 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:32:18.957168 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:19.033647 n-d-760454-3 sudo[616]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:32:19.034621 n-d-760454-3 sudo[616]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:19.917387 n-d-760454-3 sudo[594]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:19.920315 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-746a97bb-bf68-4a1d-a521-b96d5a120aff" returned: 0 in 1.469s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:19.922363 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Successfully deleted volume: 746a97bb-bf68-4a1d-a521-b96d5a120aff
Jan 25 13:32:20.053365 n-d-760454-3 sudo[590]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:20.069707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1" returned: 0 in 1.669s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:20.072389 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:32:20.076358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:20.174630 n-d-760454-3 sudo[616]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:20.189459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.233s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:20.209333 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:20.216959 n-d-760454-3 sudo[640]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03 oflag=direct
Jan 25 13:32:20.218072 n-d-760454-3 sudo[640]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:20.303978 n-d-760454-3 sudo[643]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:32:20.312953 n-d-760454-3 sudo[643]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:20.328282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Created reservations ['05e00a17-6fcc-4152-ab36-86fd3b2cbec7', '76dc770e-6f93-489f-9182-d91b564c0f71', 'fc638b40-4b98-41c0-8cb5-97e5f9384651', 'e7ccde69-c1e3-4265-aa10-cede5946450f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:32:20.333290 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:32:20.333290 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:32:20.333290 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:32:20.593236 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:32:20.593236 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:20.640309 n-d-760454-3 sudo[653]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:32:20.653014 n-d-760454-3 sudo[653]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:21.537729 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03 oflag=direct" returned: 0 in 1.373s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:21.537729 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:21.624959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.980s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:21.624959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:21.634055 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:32:21.651879 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:32:21.651879 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:32:21.447587 n-d-760454-3 sudo[640]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:21.470843 n-d-760454-3 sudo[667]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03
Jan 25 13:32:21.471428 n-d-760454-3 sudo[667]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:21.564798 n-d-760454-3 sudo[653]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:21.589549 n-d-760454-3 sudo[674]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:32:21.590067 n-d-760454-3 sudo[674]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:21.686635 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (b25a93c2-f8c0-4d0a-8e36-7be5905355a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:21.714620 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19d0b12-95ee-4389-a064-4de708b83cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:21.729087 n-d-760454-3 sudo[643]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:21.813369 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.600s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:21.826717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:32:21.932148 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:32:21.963296 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b19d0b12-95ee-4389-a064-4de708b83cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-361128976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=55b79d2e-20ba-48da-8293-6c9dd4b3c397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:32:21Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:21.985488 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df868157-efb5-48a1-8690-b110b066e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:21.988513 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df868157-efb5-48a1-8690-b110b066e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:21.991954 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986fae3b-659e-4385-8a6d-7d1f2c8d6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:22.009190 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986fae3b-659e-4385-8a6d-7d1f2c8d6d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'volume_name': 'volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:22.017912 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1691aafa-b321-4d3e-a492-5b3869864d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:22.027893 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1691aafa-b321-4d3e-a492-5b3869864d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:22.054678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcb3867-f778-4b98-a740-3b60b92454a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:22.055590 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Volume 55b79d2e-20ba-48da-8293-6c9dd4b3c397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'volume_size': 1}
Jan 25 13:32:22.064379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:22.116349 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:32:22.132323 n-d-760454-3 sudo[676]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:22.141186 n-d-760454-3 sudo[676]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:22.266329 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-da8a2ce2-f37c-4af3-bffe-21e796217ca5 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-438be147-f942-49db-9273-0574ecb92801-delete_volume'" released by "delete_volume" :: held 7.947s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:32:22.693937 n-d-760454-3 sudo[674]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:22.696414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.127s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:22.698170 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:32:22.722712 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Deleted volume successfully.
Jan 25 13:32:22.802857 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a4e3c871-5ff5-4c2d-a89c-0238dd47c427 tempest-VolumesBackupsV39Test-240834003 None] Lock "b'cinder-746a97bb-bf68-4a1d-a521-b96d5a120aff-delete_volume'" released by "delete_volume" :: held 7.557s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:32:23.751284 n-d-760454-3 sudo[676]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:23.753964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.697s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:23.758146 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dcb3867-f778-4b98-a740-3b60b92454a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:23.761817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf623c2-81c2-42e8-a9ba-e51ea51966fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:23.876425 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Volume volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 (55b79d2e-20ba-48da-8293-6c9dd4b3c397): created successfully
Jan 25 13:32:23.917032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf623c2-81c2-42e8-a9ba-e51ea51966fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:23.917032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (b25a93c2-f8c0-4d0a-8e36-7be5905355a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:24.064418 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-693ea056-e97d-491a-a8bd-d07f9eddfcf1 tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:32:25.883987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:32:25.889335 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:32:25.890072 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:32:25.920962 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (aafd9aa5-5e07-4d6e-bfa0-484faac4b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:25.924388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521d192-f98a-4320-94e5-9d96897226cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:25.952567 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:32:25.994572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521d192-f98a-4320-94e5-9d96897226cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2116404560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=4565a88a-8d51-423c-b797-c29fc01dc847,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=55b79d2e-20ba-48da-8293-6c9dd4b3c397,status='creating',terminated_at=None,updated_at=2021-01-25T13:32:26Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:25.994572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc4a23-c259-4062-8872-fe76e0c817dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:25.994572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8efc4a23-c259-4062-8872-fe76e0c817dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:25.994572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e4a5df-e293-49a5-9072-4391591c82aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:26.062773 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e4a5df-e293-49a5-9072-4391591c82aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4565a88a-8d51-423c-b797-c29fc01dc847', 'volume_name': 'volume-4565a88a-8d51-423c-b797-c29fc01dc847', 'volume_size': 1, 'source_volid': '55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:26.068983 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb2cce0-0b44-4ba7-9869-d72b10477343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:26.073397 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb2cce0-0b44-4ba7-9869-d72b10477343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:26.077047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f714d4ff-53a9-4167-9c2f-68dd82ff2e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:26.080392 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Volume 4565a88a-8d51-423c-b797-c29fc01dc847: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4565a88a-8d51-423c-b797-c29fc01dc847', 'volume_size': 1, 'source_volid': '55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'source_volstatus': 'available'}
Jan 25 13:32:26.174063 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Creating clone of volume: 55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:32:26.185457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:26.220412 n-d-760454-3 sudo[752]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:32:26.221073 n-d-760454-3 sudo[752]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:27.344464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397" returned: 0 in 1.142s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:27.344464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 --snapshot stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:27.321969 n-d-760454-3 sudo[752]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:27.344740 n-d-760454-3 sudo[756]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 --snapshot stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 -L 1.00g
Jan 25 13:32:27.345299 n-d-760454-3 sudo[756]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:28.544481 n-d-760454-3 sudo[756]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:28.547342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 --snapshot stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 -L 1.00g" returned: 0 in 1.221s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:28.549697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4565a88a-8d51-423c-b797-c29fc01dc847 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:28.583784 n-d-760454-3 sudo[859]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4565a88a-8d51-423c-b797-c29fc01dc847 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:28.585216 n-d-760454-3 sudo[859]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:29.334967 n-d-760454-3 sudo[859]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:29.337687 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-4565a88a-8d51-423c-b797-c29fc01dc847 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.787s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:29.340385 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:29.364253 n-d-760454-3 sudo[890]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:32:29.365629 n-d-760454-3 sudo[890]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:30.056471 n-d-760454-3 sudo[890]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:30.059095 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 0.719s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:30.061842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:30.104589 n-d-760454-3 sudo[894]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 iflag=direct
Jan 25 13:32:30.109899 n-d-760454-3 sudo[894]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:30.791620 n-d-760454-3 sudo[894]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:30.794009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 iflag=direct" returned: 0 in 0.732s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:30.795508 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:30.839850 n-d-760454-3 sudo[904]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 oflag=direct
Jan 25 13:32:30.840645 n-d-760454-3 sudo[904]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:31.359043 n-d-760454-3 sudo[904]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:31.371149 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 oflag=direct" returned: 0 in 0.575s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:31.372966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:31.436114 n-d-760454-3 sudo[914]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:32:31.446515 n-d-760454-3 sudo[914]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:49.416125 n-d-760454-3 sudo[667]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:49.419589 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03" returned: 0 in 27.968s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:49.420898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:49.748139 n-d-760454-3 sudo[1009]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1
Jan 25 13:32:49.749044 n-d-760454-3 sudo[1009]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:50.797308 n-d-760454-3 sudo[1009]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:50.801272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1" returned: 0 in 1.379s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:50.803536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpou7g87ojn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 27.97 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--7b3f511f--6059--4b05--9869--3e4479a3bf03 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:32:50.803684 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Converted 700.00 MB image at 25.03 MB/s
Jan 25 13:32:50.804441 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 7b3f511f-6059-4b05-9869-3e4479a3bf03 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:32:51.071684 n-d-760454-3 sudo[914]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:51.324769 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user e05ff2642a9b43da927aa763694ac642 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:32:51.326362 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Marking volume 7b3f511f-6059-4b05-9869-3e4479a3bf03 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:32:51.342773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 19.970s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:51.344617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-clone--snap--4565a88a--8d51--423c--b797--c29fc01dc847, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--4565a88a--8d51--423c--b797--c29fc01dc847, size 1024.00 MB, duration 19.97 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:32:51.345508 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Volume copy 1024.00 MB at 51.27 MB/s
Jan 25 13:32:51.347121 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:51.391479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 7b3f511f-6059-4b05-9869-3e4479a3bf03. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:32:51.392685 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Creating volume glance metadata for volume 7b3f511f-6059-4b05-9869-3e4479a3bf03 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:32:51.431749 n-d-760454-3 sudo[1020]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:32:51.435161 n-d-760454-3 sudo[1020]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:51.773696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a1a5c5-bffd-42cc-900a-4405fd72e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3f511f-6059-4b05-9869-3e4479a3bf03', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4be3c8>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:51.773696 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ab22b5-f484-4a0c-a7e8-8617d728b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:51.818765 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 (7b3f511f-6059-4b05-9869-3e4479a3bf03): created successfully
Jan 25 13:32:51.820850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ab22b5-f484-4a0c-a7e8-8617d728b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:51.825863 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (87eea29d-5c67-4341-82ee-cc2637f5f762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:51.875003 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-308f4569-b6a7-4a4d-a4b3-2e124a820849 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:32:52.973371 n-d-760454-3 sudo[1020]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:52.975993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 1.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:52.978579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:53.022316 n-d-760454-3 sudo[1029]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:32:53.024200 n-d-760454-3 sudo[1029]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:53.424720 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f275fbfa-dd17-428c-bd88-d61b66745d2b tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:53.461934 n-d-760454-3 sudo[1038]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:32:53.462513 n-d-760454-3 sudo[1038]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:54.621318 n-d-760454-3 sudo[1038]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:54.623724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f275fbfa-dd17-428c-bd88-d61b66745d2b tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03" returned: 0 in 1.199s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:54.625640 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f275fbfa-dd17-428c-bd88-d61b66745d2b tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 --snapshot stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:54.662122 n-d-760454-3 sudo[1117]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 --snapshot stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 -L 1.00g
Jan 25 13:32:54.668555 n-d-760454-3 sudo[1117]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:54.698160 n-d-760454-3 sudo[1029]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:54.700655 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/clone-snap-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 1.722s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:54.705580 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f714d4ff-53a9-4167-9c2f-68dd82ff2e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4565a88a-8d51-423c-b797-c29fc01dc847', 'volume_size': 1, 'source_volid': '55b79d2e-20ba-48da-8293-6c9dd4b3c397', 'source_volstatus': 'available'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:54.711146 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07b3750-f59a-4841-8fc3-faadf84e3e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:54.814387 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Volume volume-4565a88a-8d51-423c-b797-c29fc01dc847 (4565a88a-8d51-423c-b797-c29fc01dc847): created successfully
Jan 25 13:32:54.822617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07b3750-f59a-4841-8fc3-faadf84e3e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:54.839188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (aafd9aa5-5e07-4d6e-bfa0-484faac4b410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:54.892869 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0b09a6e4-7df9-4bc7-99b9-aac1d8c9bdee tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:32:56.073823 n-d-760454-3 sudo[1117]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:56.077946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f275fbfa-dd17-428c-bd88-d61b66745d2b tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 --snapshot stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 -L 1.00g" returned: 0 in 1.453s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:56.567443 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f275fbfa-dd17-428c-bd88-d61b66745d2b tempest-TestVolumeBootPattern-1757403332 None] Create snapshot completed successfully
Jan 25 13:32:57.853248 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:32:57.853248 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:32:57.853248 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:32:57.886915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (c66d69db-9f1a-4cdf-9a49-8c4500d350de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:57.899384 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7724dacc-d3a3-44cf-8721-b23dac3eaf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:57.961990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:32:58.049724 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7724dacc-d3a3-44cf-8721-b23dac3eaf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:32:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1408965547',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=62cb989e-affd-48a4-a415-a6c267c9ec9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:32:58Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:58.056548 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a710c7-936b-4b11-afa9-6e0cf4662f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:58.060159 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a710c7-936b-4b11-afa9-6e0cf4662f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:58.063670 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e2b3d8-fa4c-4c78-badf-26c95d9def2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:58.068329 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e2b3d8-fa4c-4c78-badf-26c95d9def2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cb989e-affd-48a4-a415-a6c267c9ec9e', 'volume_name': 'volume-62cb989e-affd-48a4-a415-a6c267c9ec9e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:58.072055 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6cb2af-4f92-4e62-b78b-75eacfe0de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:58.074997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6cb2af-4f92-4e62-b78b-75eacfe0de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:58.082469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3628823e-7631-44c5-a797-16446ade18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:58.083363 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Volume 62cb989e-affd-48a4-a415-a6c267c9ec9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cb989e-affd-48a4-a415-a6c267c9ec9e', 'volume_size': 1}
Jan 25 13:32:58.087388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-62cb989e-affd-48a4-a415-a6c267c9ec9e stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:32:58.145241 n-d-760454-3 sudo[1306]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-62cb989e-affd-48a4-a415-a6c267c9ec9e stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:32:58.148678 n-d-760454-3 sudo[1306]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:32:59.136409 n-d-760454-3 sudo[1306]: pam_unix(sudo:session): session closed for user root
Jan 25 13:32:59.138707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-62cb989e-affd-48a4-a415-a6c267c9ec9e stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.051s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:32:59.159140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3628823e-7631-44c5-a797-16446ade18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cb989e-affd-48a4-a415-a6c267c9ec9e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:59.159140 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f2c4d0-2d92-486c-ae38-c40c8cd20ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:32:59.213472 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Volume volume-62cb989e-affd-48a4-a415-a6c267c9ec9e (62cb989e-affd-48a4-a415-a6c267c9ec9e): created successfully
Jan 25 13:32:59.218401 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f2c4d0-2d92-486c-ae38-c40c8cd20ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:32:59.226030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (c66d69db-9f1a-4cdf-9a49-8c4500d350de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:32:59.286436 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-eae79262-bd4f-4087-8403-876e7d265196 tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:33:00.905299 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Lock "b'cinder-62cb989e-affd-48a4-a415-a6c267c9ec9e-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:33:01.168918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 62cb989e-affd-48a4-a415-a6c267c9ec9e
Jan 25 13:33:01.169889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:01.194716 n-d-760454-3 sudo[1395]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e
Jan 25 13:33:01.198957 n-d-760454-3 sudo[1395]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:02.522631 n-d-760454-3 sudo[1395]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:02.525259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e" returned: 0 in 1.355s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:02.526417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:02.601966 n-d-760454-3 sudo[1412]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e
Jan 25 13:33:02.602562 n-d-760454-3 sudo[1412]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:03.167646 n-d-760454-3 sudo[1412]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:03.181094 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e" returned: 0 in 0.644s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:03.183492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:03.261441 n-d-760454-3 sudo[1416]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e
Jan 25 13:33:03.263172 n-d-760454-3 sudo[1416]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:04.082476 n-d-760454-3 sudo[1416]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:04.085095 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-62cb989e-affd-48a4-a415-a6c267c9ec9e" returned: 0 in 0.901s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:04.086884 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 62cb989e-affd-48a4-a415-a6c267c9ec9e
Jan 25 13:33:04.275416 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Created reservations ['a2796b25-ede1-4f42-93d8-918e8d4f226e', '86f777bc-5e26-4603-a57d-0463c1b4b194', '00135120-048d-4f26-ae9e-7ff550c857da', '562d374a-a4d7-4356-b138-2055d7d2428f'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:33:04.277907 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:33:04.277907 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:33:04.277907 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:33:04.440272 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:33:04.441694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:04.491171 n-d-760454-3 sudo[1425]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:33:04.491708 n-d-760454-3 sudo[1425]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:05.162289 n-d-760454-3 sudo[1425]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:05.164700 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:05.166552 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:05.211936 n-d-760454-3 sudo[1429]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:33:05.214030 n-d-760454-3 sudo[1429]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:05.331971 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-4565a88a-8d51-423c-b797-c29fc01dc847-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:33:05.567540 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:33:05.568929 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:05.634961 n-d-760454-3 sudo[1431]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:33:05.635637 n-d-760454-3 sudo[1431]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:06.468893 n-d-760454-3 sudo[1429]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:06.471316 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.304s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:06.476241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:33:06.482918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:33:06.506348 n-d-760454-3 sudo[1431]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:06.508392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 0.939s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:06.509465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:06.546448 n-d-760454-3 sudo[1439]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:33:06.547094 n-d-760454-3 sudo[1439]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:06.609102 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cfc438e3-32fc-4568-a54f-28c21baf13cc tempest-VolumesGetTest-402946656 None] Lock "b'cinder-62cb989e-affd-48a4-a415-a6c267c9ec9e-delete_volume'" released by "delete_volume" :: held 5.704s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:33:06.677439 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:33:06.682806 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:33:06.683428 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:33:06.769850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (10f763f4-3a31-4ca3-9456-39601034e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:33:06.775963 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc982a8-f77e-4726-9e0b-62f075d1a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:06.834541 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:33:06.887474 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc982a8-f77e-4726-9e0b-62f075d1a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:33:06Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=6ef04361-6df3-439b-a9d4-ce9680c68e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4fa16163-2fcf-4372-a106-83eb9e4474b8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:33:06Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:06.910010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5564a232-321c-420a-8dea-ceedfaf3a0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:06.928166 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5564a232-321c-420a-8dea-ceedfaf3a0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:06.930780 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ab0504-9f28-4665-ac00-2e3626dcfbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:06.951176 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ab0504-9f28-4665-ac00-2e3626dcfbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ef04361-6df3-439b-a9d4-ce9680c68e27', 'volume_name': 'volume-6ef04361-6df3-439b-a9d4-ce9680c68e27', 'volume_size': 1, 'snapshot_id': '4fa16163-2fcf-4372-a106-83eb9e4474b8'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:06.954149 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c86cd8-eb8b-4d78-9eac-3216fa9e7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:06.963229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c86cd8-eb8b-4d78-9eac-3216fa9e7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:06.966557 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70abe2f8-e489-487a-b56d-f84e4c74eb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:06.971457 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Volume 6ef04361-6df3-439b-a9d4-ce9680c68e27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ef04361-6df3-439b-a9d4-ce9680c68e27', 'volume_size': 1, 'snapshot_id': '4fa16163-2fcf-4372-a106-83eb9e4474b8'}
Jan 25 13:33:07.065977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:07.149588 n-d-760454-3 sudo[1441]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:33:07.154783 n-d-760454-3 sudo[1441]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:07.659932 n-d-760454-3 sudo[1439]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:07.663013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 1.153s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:07.665817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:07.721105 n-d-760454-3 sudo[1445]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:33:07.722591 n-d-760454-3 sudo[1445]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:08.165849 n-d-760454-3 sudo[1441]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:08.168918 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.103s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:08.170919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:08.212075 n-d-760454-3 sudo[1477]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8
Jan 25 13:33:08.233243 n-d-760454-3 sudo[1477]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:08.786060 n-d-760454-3 sudo[1445]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:08.790526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-4565a88a-8d51-423c-b797-c29fc01dc847" returned: 0 in 1.124s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:08.793745 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 4565a88a-8d51-423c-b797-c29fc01dc847
Jan 25 13:33:08.996795 n-d-760454-3 sudo[1477]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:08.999164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8" returned: 0 in 0.828s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:09.001336 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:09.042456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Created reservations ['3e7aefa5-80b7-47d0-b62a-f5b0e2412097', '80fd5414-d668-4dcf-ad2e-6ff82b94fa5c', '9cf46105-98be-490c-a350-eeb3c71886b8', '419a1d55-c833-428a-9c2a-6cabff9e9ee9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:33:09.047588 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:33:09.047588 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:33:09.047588 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:33:09.059246 n-d-760454-3 sudo[1488]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 iflag=direct
Jan 25 13:33:09.059858 n-d-760454-3 sudo[1488]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:09.304038 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:33:09.305618 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:09.371377 n-d-760454-3 sudo[1490]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:33:09.374734 n-d-760454-3 sudo[1490]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:10.381082 n-d-760454-3 sudo[1488]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:10.383919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 iflag=direct" returned: 0 in 1.382s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:10.385455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:10.452871 n-d-760454-3 sudo[1510]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 oflag=direct
Jan 25 13:33:10.453581 n-d-760454-3 sudo[1510]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:10.533581 n-d-760454-3 sudo[1490]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:10.543499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.234s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:10.543499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:10.596003 n-d-760454-3 sudo[1514]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:33:10.596868 n-d-760454-3 sudo[1514]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:11.722706 n-d-760454-3 sudo[1510]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:11.725209 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 oflag=direct" returned: 0 in 1.339s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:11.727122 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:11.793302 n-d-760454-3 sudo[1546]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:33:11.793899 n-d-760454-3 sudo[1546]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:11.877433 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:33:11.919624 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:33:11.920273 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:33:11.946896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (304efec2-0c71-4296-9279-81e96ee7c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:33:11.955353 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9b8375-471f-47a0-8894-621f46348797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:11.995788 n-d-760454-3 sudo[1514]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:12.012466 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.471s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:12.014274 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:33:12.024044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:33:12.090396 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9b8375-471f-47a0-8894-621f46348797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-805249328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:33:12Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:12.093174 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bb9b1e-d1a8-4f00-9c1c-4db56ed9dbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:12.095522 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bb9b1e-d1a8-4f00-9c1c-4db56ed9dbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:12.105633 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b223ed50-c806-438c-a82e-109c29aea218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:12.129814 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:33:12.276790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b223ed50-c806-438c-a82e-109c29aea218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c', 'volume_name': 'volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c21f1d0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:12.283035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371bc80e-0a94-46da-a77e-9077c1679a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:12.283035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371bc80e-0a94-46da-a77e-9077c1679a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:33:12.291116 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e0431d-da56-4a9d-b428-b5cf92aaa041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:33:12.294292 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Volume c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c21f1d0>}
Jan 25 13:33:12.299265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Cloning c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:33:12.313779 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b05c3fc6-1599-46ad-813b-3b410fd73966 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-4565a88a-8d51-423c-b797-c29fc01dc847-delete_volume'" released by "delete_volume" :: held 6.981s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:33:47.133176 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1, size 616.00 MB, duration 34.83 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:33:47.133899 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Image download 616.00 MB at 17.69 MB/s
Jan 25 13:33:47.142992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:33:47.143818 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:33:47.144806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:47.163471 n-d-760454-3 sudo[1727]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:33:47.164811 n-d-760454-3 sudo[1727]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:47.206106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:47.308363 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:47.323265 n-d-760454-3 sudo[1729]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1
Jan 25 13:33:47.323863 n-d-760454-3 sudo[1729]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:47.731068 n-d-760454-3 sudo[1727]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:47.733976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:47.737315 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:47.746390 n-d-760454-3 sudo[1729]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:47.760828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1" returned: 0 in 0.555s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:47.762494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 7f65722a53324b439a823bd24b5b33dd. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:33:47.765232 n-d-760454-3 sudo[1735]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:33:47.766043 n-d-760454-3 sudo[1735]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:48.316919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:49.322421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:50.330179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:50.375877 n-d-760454-3 cinder-volume[89138]: WARNING oslo.service.loopingcall [None req-f2de5453-4a90-49c1-b9b6-e1874e1fd5f0 None None] Function 'cinder.service.Service.report_state' run outlasted interval by 15.61 sec
Jan 25 13:33:50.413680 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:50.533463 n-d-760454-3 sudo[1735]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:50.537076 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.800s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:50.537972 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:33:50.648023 n-d-760454-3 sudo[1739]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1
Jan 25 13:33:50.651974 n-d-760454-3 sudo[1739]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:51.341430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:51.474996 n-d-760454-3 sudo[1739]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:51.478702 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1" returned: 0 in 1.065s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:51.511095 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:51.562566 n-d-760454-3 sudo[1765]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:33:51.572355 n-d-760454-3 sudo[1765]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:52.377935 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:53.074574 n-d-760454-3 sudo[1765]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:53.076881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.566s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:53.376914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:53.542040 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:33:53.690441 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmm2diuk4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:53.863224 n-d-760454-3 sudo[1835]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmm2diuk4
Jan 25 13:33:53.880379 n-d-760454-3 sudo[1835]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:54.393858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:54.835479 n-d-760454-3 sudo[1835]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:54.838104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpmm2diuk4" returned: 0 in 1.165s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:54.841212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:55.190684 n-d-760454-3 sudo[1838]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1
Jan 25 13:33:55.192626 n-d-760454-3 sudo[1838]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:55.450456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:55.781083 n-d-760454-3 sudo[1838]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:55.783259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1" returned: 0 in 0.943s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:55.784456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:33:55.785967 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:55.824200 n-d-760454-3 sudo[1842]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c oflag=direct
Jan 25 13:33:55.824745 n-d-760454-3 sudo[1842]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:56.465105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:56.869912 n-d-760454-3 sudo[1842]: pam_unix(sudo:session): session closed for user root
Jan 25 13:33:56.873672 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c oflag=direct" returned: 0 in 1.087s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:33:56.875756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:33:56.942947 n-d-760454-3 sudo[1854]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c
Jan 25 13:33:56.944750 n-d-760454-3 sudo[1854]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:33:57.476692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:58.495158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:33:59.522160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:00.003427 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:34:00.220672 n-d-760454-3 sudo[1546]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:00.230907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 48.504s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:00.232916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:00.234617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--4fa16163--2fcf--4372--a106--83eb9e4474b8, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--6ef04361--6df3--439b--a9d4--ce9680c68e27, size 1024.00 MB, duration 48.51 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:34:00.235468 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Volume copy 1024.00 MB at 21.11 MB/s
Jan 25 13:34:00.315981 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Marking volume 6ef04361-6df3-439b-a9d4-ce9680c68e27 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:34:00.334145 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-46cff428-2603-434d-8020-70bf7b4b4182-delete_volume'" acquired by "delete_volume" :: waited 0.100s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:00.406667 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Trying to delete temp volume: 46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:00.406667 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:00.428500 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from snapshot 4fa16163-2fcf-4372-a106-83eb9e4474b8 to 6ef04361-6df3-439b-a9d4-ce9680c68e27. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:418}}
Jan 25 13:34:00.545615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:00.545615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.313s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:00.545615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:00.545615 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: 46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:00.545615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:00.628210 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.227s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:00.629018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182\n            Backing store flags: \n    Account information:\n        4veB76EGVftMsGDk5M8E\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:00.630337 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: 46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:00.633796 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:00.640002 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70abe2f8-e489-487a-b56d-f84e4c74eb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef04361-6df3-439b-a9d4-ce9680c68e27', 'volume_size': 1, 'snapshot_id': '4fa16163-2fcf-4372-a106-83eb9e4474b8'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:00.647139 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d95625-49ec-40a0-a6c8-89da66feb9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:00.771429 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 (6ef04361-6df3-439b-a9d4-ce9680c68e27): created successfully
Jan 25 13:34:00.776341 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d95625-49ec-40a0-a6c8-89da66feb9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:00.784959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (10f763f4-3a31-4ca3-9456-39601034e648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:00.835597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 -f" returned: 0 in 0.199s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:00.836159 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:00.837171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-46cff428-2603-434d-8020-70bf7b4b4182 -f" returned: 0 in 0.296s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:00.837698 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:00.883781 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:00.914182 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-9378f921-9c52-4161-b68c-748f72c37b57 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:34:01.025204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.184s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:01.025914 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:01.027364 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Remove volume export completed successfully.
Jan 25 13:34:01.071037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.231s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:01.071920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:01.072952 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Volume path /opt/stack/data/cinder/volumes/volume-46cff428-2603-434d-8020-70bf7b4b4182 not found at end, of remove_iscsi_target. {{(pid=89244) remove_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:290}}
Jan 25 13:34:01.074026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:01.098395 n-d-760454-3 sudo[1953]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:01.099969 n-d-760454-3 sudo[1953]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:01.545428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:02.012858 n-d-760454-3 sudo[1953]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:02.020874 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 0.941s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:02.020874 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:02.043433 n-d-760454-3 sudo[1966]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:02.045552 n-d-760454-3 sudo[1966]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:02.572831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:02.594847 n-d-760454-3 sudo[1966]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:02.597246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 0.579s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:02.599631 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:02.620118 n-d-760454-3 sudo[1971]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:02.620773 n-d-760454-3 sudo[1971]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:03.564105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:04.570880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:04.757104 n-d-760454-3 sudo[1971]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:04.761739 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-46cff428-2603-434d-8020-70bf7b4b4182" returned: 0 in 2.161s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:04.764308 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: 46cff428-2603-434d-8020-70bf7b4b4182
Jan 25 13:34:04.771548 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:04.771548 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:04.771548 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:05.243205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:05.272784 n-d-760454-3 sudo[1980]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:05.273873 n-d-760454-3 sudo[1980]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:05.584214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:05.864638 n-d-760454-3 sudo[1980]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:05.867463 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27" returned: 0 in 0.624s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:06.006940 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:06.022031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.017s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:06.022501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 31\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 31
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         VeivRKNZdzrJH7WJ7H6y
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:34:06.023501 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:34:06.029078 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27,
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27>
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:     incominguser PXGzGpoxxSFJoYKzZz7F 67LVhoVKetNUa2WR
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:34:07.758862 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:34:07.780348 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:07.780348 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:34:07.805963 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:07.833026 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-b314e2df-48ca-47e3-9f7b-02ade6f27b61 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-46cff428-2603-434d-8020-70bf7b4b4182-delete_volume'" released by "delete_volume" :: held 7.506s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:08.771599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27" returned: 0 in 0.997s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:08.771599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:08.771599 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:34:08.771599 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:34:08.771599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:08.815273 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:08.816007 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.045s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:08.816753 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 31
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         VeivRKNZdzrJH7WJ7H6y
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:34:08.817607 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:34:08.826268 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:09.070030 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-df3fc0ae-523d-4bef-9ffe-459803e56e4a req-9b8a2d82-0ee1-45f3-9b51-f9c63eb3d13e tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:34:09.071024 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-df3fc0ae-523d-4bef-9ffe-459803e56e4a req-9b8a2d82-0ee1-45f3-9b51-f9c63eb3d13e tempest-VolumesBackupsTest-1355027314 None] Deleting attachment caf40823-4b00-44d1-b565-1270f40da9f6. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:34:09.080475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:09.195823 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.376s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:09.196421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:09.198921 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:09.277162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.200s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:09.278273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:09.279144 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-df3fc0ae-523d-4bef-9ffe-459803e56e4a req-9b8a2d82-0ee1-45f3-9b51-f9c63eb3d13e tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: 89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:09.284233 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:09.502013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.302s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:09.517559 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355168]: (4, ('Target 3: iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4\n            Backing store flags: \n    Account information:\n        VeivRKNZdzrJH7WJ7H6y\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:09.517559 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,4 iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:34:09.518528 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 -f" returned: 0 in 0.237s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:09.518528 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:09.519717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:09.722541 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.202s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:09.724247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356840]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:10.076566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:10.433908 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-df3fc0ae-523d-4bef-9ffe-459803e56e4a req-9b8a2d82-0ee1-45f3-9b51-f9c63eb3d13e tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:10.433908 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:10.433908 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:10.524274 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-c1396a8d-1d73-4475-920a-511a093ecf74 req-7a26a259-3e5a-47f4-8ac5-92cf267aa995 tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:34:11.088991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:12.097342 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:13.103256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:14.109384 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:15.132585 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:16.123855 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:17.133983 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:18.140869 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:19.149789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:20.159377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:21.169785 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:22.176210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:23.108837 n-d-760454-3 sudo[1854]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:23.110889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c" returned: 0 in 26.235s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:23.111899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:23.209926 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:23.523357 n-d-760454-3 sudo[2221]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1
Jan 25 13:34:23.523945 n-d-760454-3 sudo[2221]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:24.216979 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:24.471664 n-d-760454-3 sudo[2221]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:24.473680 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1" returned: 0 in 1.362s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:24.474919 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpikjjj2v8n-d-760454-3@lvmdriver-1, size 700.00 MB, duration 26.24 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--c75c8fa9--911e--4d1c--b3b0--5c25bcc2875c {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:34:24.475545 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Converted 700.00 MB image at 26.68 MB/s
Jan 25 13:34:24.476647 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:34:24.689943 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 7f65722a53324b439a823bd24b5b33dd is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:34:24.691026 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Marking volume c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:34:24.742746 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:34:24.744086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Creating volume glance metadata for volume c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:34:25.006891 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e0431d-da56-4a9d-b428-b5cf92aaa041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c21f1d0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:25.009423 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5265e3bc-66dd-46e8-889b-b1ab60126060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:25.066313 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Volume volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c (c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c): created successfully
Jan 25 13:34:25.068462 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5265e3bc-66dd-46e8-889b-b1ab60126060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:25.071771 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (304efec2-0c71-4296-9279-81e96ee7c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:25.130148 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fd1d1873-f508-456d-97d1-b68e32f90a48 tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:34:25.224735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:25.998532 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-89bb366f-0d1b-41fd-8cd8-851b3606d4a4-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:26.275701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:26.296600 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:26.516527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.209s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:26.516527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 33\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:26.516527 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Skipping remove_export. No iscsi_target is presently exported for volume: 89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:26.516527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:26.547034 n-d-760454-3 sudo[2236]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:26.548495 n-d-760454-3 sudo[2236]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:27.285042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:27.430977 n-d-760454-3 sudo[2236]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:27.433450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 0.927s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:27.435518 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:27.469811 n-d-760454-3 sudo[2240]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:27.473799 n-d-760454-3 sudo[2240]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:28.235880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:34:28.243107 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:34:28.243913 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:34:28.278542 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (316d9745-7420-4bea-a955-2f5a6d719a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:28.289468 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3c359c-72a7-4a2a-b87a-2246b7fed76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:28.330730 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:28.338491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:34:28.398578 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3c359c-72a7-4a2a-b87a-2246b7fed76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:34:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-79162388',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=738041a5-3703-40aa-8e41-6afe7acf5994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1f4012e4fb4af1893c3d440bf83230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:34:28Z,user_id='7f65722a53324b439a823bd24b5b33dd',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:28.401386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb025131-f638-406e-8fa6-10ca0cd2f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:28.403073 n-d-760454-3 sudo[2240]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:28.407863 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb025131-f638-406e-8fa6-10ca0cd2f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:28.415459 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258ede51-bd6c-4210-9d62-5e733e63e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:28.420592 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258ede51-bd6c-4210-9d62-5e733e63e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738041a5-3703-40aa-8e41-6afe7acf5994', 'volume_name': 'volume-738041a5-3703-40aa-8e41-6afe7acf5994', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:28.423503 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3711020d-f2d9-4ca3-a206-6cf6449ebaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:28.427848 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3711020d-f2d9-4ca3-a206-6cf6449ebaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:28.430837 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c7e717-7ca6-4315-9016-8a8032ece78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:28.432073 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Volume 738041a5-3703-40aa-8e41-6afe7acf5994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738041a5-3703-40aa-8e41-6afe7acf5994', 'volume_size': 1}
Jan 25 13:34:28.433620 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-738041a5-3703-40aa-8e41-6afe7acf5994 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:28.454981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 1.019s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:28.457398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:28.469053 n-d-760454-3 sudo[2244]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-738041a5-3703-40aa-8e41-6afe7acf5994 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:34:28.470287 n-d-760454-3 sudo[2244]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:28.506348 n-d-760454-3 sudo[2245]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:28.507458 n-d-760454-3 sudo[2245]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:28.888717 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-678da812-fe4e-4c73-9516-186587306e91 tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-1753806410: creating
Jan 25 13:34:28.970152 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-678da812-fe4e-4c73-9516-186587306e91 tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-1753806410: created successfully
Jan 25 13:34:28.998162 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-678da812-fe4e-4c73-9516-186587306e91 tempest-GroupSnapshotsTest-917539146 None] Create group completed successfully.
Jan 25 13:34:29.241065 n-d-760454-3 sudo[2244]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:29.243677 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-738041a5-3703-40aa-8e41-6afe7acf5994 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.810s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:29.250409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c7e717-7ca6-4315-9016-8a8032ece78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738041a5-3703-40aa-8e41-6afe7acf5994', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:29.255836 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6fe40c-b649-4c54-a71e-07b61b8598c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:29.317239 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Volume volume-738041a5-3703-40aa-8e41-6afe7acf5994 (738041a5-3703-40aa-8e41-6afe7acf5994): created successfully
Jan 25 13:34:29.319519 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6fe40c-b649-4c54-a71e-07b61b8598c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:29.322965 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Flow 'volume_create_manager' (316d9745-7420-4bea-a955-2f5a6d719a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:29.337230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:29.377207 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a2df2a79-c351-48f8-846d-5e21296f3502 tempest-VolumesGetTest-402946656 None] Created volume successfully.
Jan 25 13:34:29.423980 n-d-760454-3 sudo[2245]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:29.426282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-89bb366f-0d1b-41fd-8cd8-851b3606d4a4" returned: 0 in 0.969s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:29.427190 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: 89bb366f-0d1b-41fd-8cd8-851b3606d4a4
Jan 25 13:34:29.552922 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Created reservations ['579e8e5c-117d-41ed-a337-a5d7ba1abc44', 'f759a96f-d054-443a-9f1b-a4061c54b2ac', 'a330669f-bed7-4a34-9171-5b44fee20408', 'e48c242f-2339-4a5d-b3a0-3713db543829'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:29.555225 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:29.555225 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:29.555225 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:29.707188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:29.708660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:29.749649 n-d-760454-3 sudo[2283]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:29.754935 n-d-760454-3 sudo[2283]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:29.761088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-738041a5-3703-40aa-8e41-6afe7acf5994-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:29.993462 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 738041a5-3703-40aa-8e41-6afe7acf5994
Jan 25 13:34:29.995009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:30.040910 n-d-760454-3 sudo[2285]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994
Jan 25 13:34:30.042029 n-d-760454-3 sudo[2285]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:30.345828 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:30.529025 n-d-760454-3 sudo[2283]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:30.532985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.824s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:30.537433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:30.599676 n-d-760454-3 sudo[2289]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:30.604793 n-d-760454-3 sudo[2289]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:31.284924 n-d-760454-3 sudo[2285]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:31.287771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994" returned: 0 in 1.292s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:31.289473 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:31.347790 n-d-760454-3 sudo[2293]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994
Jan 25 13:34:31.349029 n-d-760454-3 sudo[2293]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:31.387895 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:31.420932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:34:31.434115 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:34:31.434772 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:34:31.453108 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (374243e2-c819-4446-bab0-6aa45575a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:31.457743 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58d7512-9122-4f1d-9174-dff4c0439a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:31.566197 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:34:31.656370 n-d-760454-3 sudo[2289]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:31.800904 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58d7512-9122-4f1d-9174-dff4c0439a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1756413224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e198e3ee-2f95-42d0-83b5-d9c4810dcd48,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c72195ab-8b22-4cf0-9cd2-52f66d41d1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ce7d7a17f14b329cc3f01669fb7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:34:31Z,user_id='b1985c91851b49f7add29cb07f0d5005',volume_attachment=<?>,volume_type=VolumeType(ddf63793-4a66-4a78-9e72-1cc6addf2c73),volume_type_id=ddf63793-4a66-4a78-9e72-1cc6addf2c73)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:31.804086 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fa596b-081c-410e-9710-07fa13ca55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:31.807666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fa596b-081c-410e-9710-07fa13ca55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:31.810583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98fe43-4b23-4bb2-ab43-259b4d627684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:31.814163 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98fe43-4b23-4bb2-ab43-259b4d627684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72195ab-8b22-4cf0-9cd2-52f66d41d1d0', 'volume_name': 'volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:31.816896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3805b28d-1471-4237-a37e-7af0585cd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:31.819825 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3805b28d-1471-4237-a37e-7af0585cd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:31.822916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445b65e6-be96-4c2b-9d5f-05f180c7403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:31.832055 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.297s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:31.839413 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:31.854951 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Volume c72195ab-8b22-4cf0-9cd2-52f66d41d1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0', 'volume_size': 1}
Jan 25 13:34:31.856321 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:31.875324 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:34:31.890712 n-d-760454-3 sudo[2297]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:34:31.891589 n-d-760454-3 sudo[2297]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:31.957758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f3c6a650-cead-4ad3-93f8-7639c96f3ef7 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-89bb366f-0d1b-41fd-8cd8-851b3606d4a4-delete_volume'" released by "delete_volume" :: held 5.959s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:32.098832 n-d-760454-3 sudo[2293]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:32.100998 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994" returned: 0 in 0.812s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:32.102894 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:32.136312 n-d-760454-3 sudo[2301]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994
Jan 25 13:34:32.137379 n-d-760454-3 sudo[2301]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:32.367438 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:34:32.373105 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:34:32.373870 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:34:32.392296 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (f487b19b-ed83-4352-8eb6-6d7646c12746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:32.397313 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f977bd71-7f1c-4c58-9310-caa0509b5f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.427536 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:34:32.461875 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f977bd71-7f1c-4c58-9310-caa0509b5f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1878146832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b0a84695-2a50-47dd-a178-af956c05ae7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330f089a4942a7a8f1eba58db88685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:34:32Z,user_id='253e9e6711fa4978b18bbf3697b15cbf',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.465029 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86eea9b8-9e78-476d-95ef-be055602758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.467600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86eea9b8-9e78-476d-95ef-be055602758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.471380 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228602f4-5f89-4210-a35c-fc3ce5c5618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.480998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:32.590847 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228602f4-5f89-4210-a35c-fc3ce5c5618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0a84695-2a50-47dd-a178-af956c05ae7b', 'volume_name': 'volume-b0a84695-2a50-47dd-a178-af956c05ae7b', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1e2be0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.594139 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2445cc2-579b-4574-9cfe-36aaf5f42239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.596911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2445cc2-579b-4574-9cfe-36aaf5f42239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.599690 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e5e69-ee50-4791-b983-786e1344228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.600685 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Volume b0a84695-2a50-47dd-a178-af956c05ae7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0a84695-2a50-47dd-a178-af956c05ae7b', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1e2be0>}
Jan 25 13:34:32.601429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Cloning b0a84695-2a50-47dd-a178-af956c05ae7b from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:34:32.793942 n-d-760454-3 sudo[2297]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:32.797195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.940s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:32.802775 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445b65e6-be96-4c2b-9d5f-05f180c7403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.805138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e42dce-dcf0-4fbb-a798-39cd90617100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:34:32.868338 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Volume volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 (c72195ab-8b22-4cf0-9cd2-52f66d41d1d0): created successfully
Jan 25 13:34:32.870719 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e42dce-dcf0-4fbb-a798-39cd90617100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:34:32.875081 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (374243e2-c819-4446-bab0-6aa45575a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:34:32.924569 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1ff422df-0527-496e-803e-294f27772255 tempest-GroupSnapshotsTest-917539146 None] Created volume successfully.
Jan 25 13:34:33.003876 n-d-760454-3 sudo[2301]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:33.005756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-738041a5-3703-40aa-8e41-6afe7acf5994" returned: 0 in 0.903s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:33.006599 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 738041a5-3703-40aa-8e41-6afe7acf5994
Jan 25 13:34:33.113690 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Created reservations ['ecceef10-ba4d-4e45-a1b7-a1b8a2c5d3c5', 'df95c862-14d0-4732-8a5b-f1cab691e0ea', '090ec268-6f93-457e-921e-f035a1e28f7c', '0142ce66-31ca-4c31-a11e-c5dc583a1bc9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:33.116495 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:33.116495 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:33.116495 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:33.295269 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:33.296486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:33.321252 n-d-760454-3 sudo[2338]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:33.323795 n-d-760454-3 sudo[2338]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:33.510341 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:33.554661 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] GroupSnapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: creating.
Jan 25 13:34:33.611877 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] Group snapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: creating. {{(pid=89244) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:3846}}
Jan 25 13:34:33.773958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:33.823720 n-d-760454-3 sudo[2342]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:34:33.824367 n-d-760454-3 sudo[2342]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:33.920451 n-d-760454-3 sudo[2338]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:33.930799 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:33.933421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:33.986560 n-d-760454-3 sudo[2346]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:34.005147 n-d-760454-3 sudo[2346]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:34.293338 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c-delete_volume'" acquired by "delete_volume" :: waited 0.064s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:34.525320 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c
Jan 25 13:34:34.526290 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:34.580259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:34.583436 n-d-760454-3 sudo[2358]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c
Jan 25 13:34:34.585289 n-d-760454-3 sudo[2358]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:34.828415 n-d-760454-3 sudo[2342]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:34.831772 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0" returned: 0 in 1.059s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:34.833471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 --snapshot stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:34.860102 n-d-760454-3 sudo[2364]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 --snapshot stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 -L 1.00g
Jan 25 13:34:34.861078 n-d-760454-3 sudo[2364]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:34.990234 n-d-760454-3 sudo[2346]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:34.994309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.061s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:34.996843 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:35.005231 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:34:35.062931 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-bc2e82e4-d6e3-44c6-a32b-d4842104b692 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-738041a5-3703-40aa-8e41-6afe7acf5994-delete_volume'" released by "delete_volume" :: held 5.302s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:35.378478 n-d-760454-3 sudo[2358]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:35.380722 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c" returned: 0 in 0.854s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:35.382587 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:35.428813 n-d-760454-3 sudo[2369]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c
Jan 25 13:34:35.429607 n-d-760454-3 sudo[2369]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:35.616177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:36.038302 n-d-760454-3 sudo[2364]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:36.052494 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 --snapshot stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 -L 1.00g" returned: 0 in 1.219s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:36.354716 n-d-760454-3 sudo[2369]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:36.357633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c" returned: 0 in 0.975s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:36.359719 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:36.398215 n-d-760454-3 sudo[2470]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c
Jan 25 13:34:36.409673 n-d-760454-3 sudo[2470]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:36.420217 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-318e1533-d975-4fef-b1e1-f966e6b0f3be tempest-GroupSnapshotsTest-917539146 None] group_snapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: created successfully
Jan 25 13:34:36.644192 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:37.324033 n-d-760454-3 sudo[2470]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:37.326845 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c" returned: 0 in 0.967s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:37.329595 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c
Jan 25 13:34:37.490421 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Created reservations ['7f1c3b59-b101-4979-82bf-76bb909ca065', '5e693267-93bc-43ab-bee0-b244d25e6680', 'ace984fd-d688-463f-9eec-9819c70637ac', 'e84cc972-2a25-4b9c-92fe-86d999f53828'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:37.490421 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:37.490421 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:37.490421 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:37.669550 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:37.874088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:37.882211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:37.956061 n-d-760454-3 sudo[2479]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:37.963424 n-d-760454-3 sudo[2479]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:38.550623 n-d-760454-3 sudo[2479]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:38.558002 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:38.560570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:38.585401 n-d-760454-3 sudo[2483]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:38.590933 n-d-760454-3 sudo[2483]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:38.698085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:38.951172 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-55b79d2e-20ba-48da-8293-6c9dd4b3c397-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:39.206041 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Skipping remove_export. No iscsi_target is presently exported for volume: 55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:34:39.207700 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:39.275131 n-d-760454-3 sudo[2485]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:34:39.275775 n-d-760454-3 sudo[2485]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:39.722364 n-d-760454-3 sudo[2483]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:39.756355 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.196s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:39.758258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6b75cce8-0152-4a3b-aa64-d96041c903ea stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:39.806861 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:39.813514 n-d-760454-3 sudo[2489]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6b75cce8-0152-4a3b-aa64-d96041c903ea stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:34:39.815418 n-d-760454-3 sudo[2489]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:39.863564 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:34:39.888920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:39.942541 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-779269de-9b88-49e7-885d-1542544ecbd7 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-c75c8fa9-911e-4d1c-b3b0-5c25bcc2875c-delete_volume'" released by "delete_volume" :: held 5.651s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:40.535896 n-d-760454-3 sudo[2485]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:40.539154 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397" returned: 0 in 1.331s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:40.542267 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:40.582044 n-d-760454-3 sudo[2494]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:34:40.584752 n-d-760454-3 sudo[2494]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:40.931085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:41.094214 n-d-760454-3 sudo[2489]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:41.096888 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-6b75cce8-0152-4a3b-aa64-d96041c903ea stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.338s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:41.110225 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:41.169966 n-d-760454-3 sudo[2545]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0
Jan 25 13:34:41.176762 n-d-760454-3 sudo[2545]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:41.531435 n-d-760454-3 sudo[2494]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:41.533872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397" returned: 0 in 0.991s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:41.537813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:41.614635 n-d-760454-3 sudo[2554]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:34:41.617405 n-d-760454-3 sudo[2554]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:41.846738 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-5b2d16cf-476d-48ff-82ee-640d57756b1b tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:34:41.847660 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-5b2d16cf-476d-48ff-82ee-640d57756b1b tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 5a6c7d99-866c-4ec9-bcae-24132e03b413. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:34:41.854892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:41.959440 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:42.022391 n-d-760454-3 sudo[2545]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:42.024571 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0" returned: 0 in 0.915s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.039808 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:42.067682 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.210s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.068275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27\n            Backing store flags: \n    Account information:\n        PXGzGpoxxSFJoYKzZz7F\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:42.069780 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-5b2d16cf-476d-48ff-82ee-640d57756b1b tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: 6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:42.071442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:42.085930 n-d-760454-3 sudo[2566]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea iflag=direct
Jan 25 13:34:42.088683 n-d-760454-3 sudo[2566]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:42.299305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 -f" returned: 0 in 0.224s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.300875 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:42.305481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:42.423300 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.120s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.423786 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:42.597554 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-5b2d16cf-476d-48ff-82ee-640d57756b1b tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:42.597554 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:42.597554 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:42.608720 n-d-760454-3 sudo[2554]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:42.614419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55b79d2e-20ba-48da-8293-6c9dd4b3c397" returned: 0 in 1.076s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.616575 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Successfully deleted volume: 55b79d2e-20ba-48da-8293-6c9dd4b3c397
Jan 25 13:34:42.713723 n-d-760454-3 sudo[2566]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:42.716086 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea iflag=direct" returned: 0 in 0.676s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:42.718341 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:42.746985 n-d-760454-3 sudo[2596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea oflag=direct
Jan 25 13:34:42.747549 n-d-760454-3 sudo[2596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:42.757362 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Created reservations ['2152fdbe-bf9f-493f-ace6-9c965a672616', '404b7a19-72f5-427d-8381-9f06dd51eba2', '452719ac-5d2e-4720-b383-a5148166e274', '59f6d1b2-f119-4cfd-9197-dd31e74c0c29'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:42.763298 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:42.763298 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:42.763298 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:42.987332 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:43.005435 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:43.006349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:43.050520 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-6ef04361-6df3-439b-a9d4-ce9680c68e27-delete_volume'" acquired by "delete_volume" :: waited 0.072s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:43.069266 n-d-760454-3 sudo[2598]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:43.074728 n-d-760454-3 sudo[2598]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:43.357499 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:43.518724 n-d-760454-3 sudo[2596]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:43.526043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea oflag=direct" returned: 0 in 0.808s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:43.529019 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:43.567900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.199s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:43.568507 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:34:43.570042 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: 6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:43.571997 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:43.590738 n-d-760454-3 sudo[2609]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:34:43.592212 n-d-760454-3 sudo[2609]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:43.672820 n-d-760454-3 sudo[2611]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:43.684343 n-d-760454-3 sudo[2611]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:43.828601 n-d-760454-3 sudo[2598]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:43.831982 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:43.835331 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:43.965591 n-d-760454-3 sudo[2618]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:43.966415 n-d-760454-3 sudo[2618]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:44.018717 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:45.049199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:45.536316 n-d-760454-3 sudo[2618]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:45.544205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.709s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:45.558181 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:45.579352 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Deleted volume successfully.
Jan 25 13:34:45.650182 n-d-760454-3 sudo[2611]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:45.657450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27" returned: 0 in 2.085s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:45.660306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:45.725703 n-d-760454-3 sudo[2625]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:45.734126 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7002a6da-dec9-4d5b-996a-b664565cf9f8 tempest-VolumesGetTest-402946656 None] Lock "b'cinder-55b79d2e-20ba-48da-8293-6c9dd4b3c397-delete_volume'" released by "delete_volume" :: held 6.788s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:45.735686 n-d-760454-3 sudo[2625]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:46.082421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:46.919473 n-d-760454-3 sudo[2625]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:46.925297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27" returned: 0 in 1.265s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:46.928167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:46.972913 n-d-760454-3 sudo[2631]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:46.973484 n-d-760454-3 sudo[2631]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:47.148472 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:34:47.149070 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:47.149750 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:47.206351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:47.242902 n-d-760454-3 sudo[2636]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:47.243485 n-d-760454-3 sudo[2636]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:48.277879 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:48.647933 n-d-760454-3 sudo[2631]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:48.661394 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6ef04361-6df3-439b-a9d4-ce9680c68e27" returned: 0 in 1.724s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:48.661394 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: 6ef04361-6df3-439b-a9d4-ce9680c68e27
Jan 25 13:34:49.010340 n-d-760454-3 sudo[2636]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:49.015704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.866s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:49.022747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:49.085359 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['f031c189-08cd-4a06-a82e-befb45214c1c', '2936008e-28c7-4867-bf87-1f9bc3032c66', '48b17725-01f1-4f0d-ad3b-865a7ef18031', '3414fb22-762d-479d-9af4-b051b30e7de7'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:49.089434 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:49.089434 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:49.089434 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:49.100898 n-d-760454-3 sudo[2648]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:49.101489 n-d-760454-3 sudo[2648]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:49.311646 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:49.332963 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:49.341896 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:49.398377 n-d-760454-3 sudo[2650]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:49.400362 n-d-760454-3 sudo[2650]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:50.504836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:50.639042 n-d-760454-3 sudo[2650]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:50.642068 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.300s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:50.649893 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:50.660878 n-d-760454-3 sudo[2648]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:50.687504 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.668s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:50.689579 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:50.703369 n-d-760454-3 sudo[2656]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:34:50.707856 n-d-760454-3 sudo[2656]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:51.689346 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-4fa16163-2fcf-4372-a106-83eb9e4474b8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.116s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:51.699482 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:51.734964 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:51.745103 n-d-760454-3 sudo[2658]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8
Jan 25 13:34:51.746532 n-d-760454-3 sudo[2658]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:52.342132 n-d-760454-3 sudo[2656]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:52.347558 n-d-760454-3 sudo[2609]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:52.349679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.700s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:52.357248 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:34:52.370828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 8.842s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:52.372776 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--ec8dafc5--6a50--43c3--8484--1bdb2a783ee0, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--6b75cce8--0152--4a3b--aa64--d96041c903ea, size 1024.00 MB, duration 8.84 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:34:52.376456 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Volume copy 1024.00 MB at 115.79 MB/s
Jan 25 13:34:52.401342 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:34:52.513625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-ff8e705b-cd73-4dbc-b421-3979c66eef3e req-1fb8eafc-cbaf-4900-8568-5b99c847a528 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-6ef04361-6df3-439b-a9d4-ce9680c68e27-delete_volume'" released by "delete_volume" :: held 9.453s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:52.728803 n-d-760454-3 sudo[2658]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:52.810275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8" returned: 0 in 1.113s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:52.877849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:52.981638 n-d-760454-3 sudo[2696]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8
Jan 25 13:34:52.982241 n-d-760454-3 sudo[2696]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:53.003252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:53.546123 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-912f2b37-66d8-4e4b-9a3b-4492a58004d1 tempest-GroupSnapshotsTest-917539146 None] Create group from source-snapshot-5d71f404-f0d6-4343-adcd-8a08010b15fc completed successfully.
Jan 25 13:34:54.019514 n-d-760454-3 sudo[2696]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:54.055566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4fa16163-2fcf-4372-a106-83eb9e4474b8" returned: 0 in 1.178s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:54.155481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:54.212050 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Skipping remove_export. No iscsi_target is presently exported for volume: 6b75cce8-0152-4a3b-aa64-d96041c903ea
Jan 25 13:34:54.213070 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:54.260262 n-d-760454-3 sudo[2752]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea
Jan 25 13:34:54.260968 n-d-760454-3 sudo[2752]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:54.416442 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['199922d4-86bc-4960-9b1e-ed8cc47fe8a1', '70997832-cdf0-4993-b2fc-ab35c0897705', 'da596f31-73f4-4b8b-966e-f8c3627e7f7d', 'ea2f6edb-0c2e-448f-b5fb-a57b152eee25'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:54.421283 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:54.421283 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:54.421283 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:54.696267 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Delete snapshot completed successfully.
Jan 25 13:34:54.704959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9cffa060-ad8c-463f-a265-9c50208de385 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-4fa16163-2fcf-4372-a106-83eb9e4474b8-delete_snapshot'" released by "delete_snapshot" :: held 3.031s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:34:55.180210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:55.207009 n-d-760454-3 sudo[2752]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:55.209831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea" returned: 0 in 0.997s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:55.213373 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:55.299609 n-d-760454-3 sudo[2766]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea
Jan 25 13:34:55.300202 n-d-760454-3 sudo[2766]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:55.530993 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-7b3f511f-6059-4b05-9869-3e4479a3bf03-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:34:55.789826 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: 7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:34:55.791345 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:55.900813 n-d-760454-3 sudo[2779]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:34:55.901426 n-d-760454-3 sudo[2779]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:56.232732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:56.692219 n-d-760454-3 sudo[2766]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:56.696085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea" returned: 0 in 1.483s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:56.699255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:56.747060 n-d-760454-3 sudo[2797]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea
Jan 25 13:34:56.754424 n-d-760454-3 sudo[2797]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:57.276658 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:57.390408 n-d-760454-3 sudo[2779]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:57.392376 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03" returned: 0 in 1.601s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:57.395981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:57.434282 n-d-760454-3 sudo[2813]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:34:57.435054 n-d-760454-3 sudo[2813]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:57.621568 n-d-760454-3 sudo[2797]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:57.639546 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-6b75cce8-0152-4a3b-aa64-d96041c903ea" returned: 0 in 0.939s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:57.641571 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Successfully deleted volume: 6b75cce8-0152-4a3b-aa64-d96041c903ea
Jan 25 13:34:57.994050 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Created reservations ['70aee815-913f-489f-91c3-11b350e9fa61'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:58.103802 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-859268667 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-859268667, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:34:58.105826 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-859268667 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-859268667, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:34:58.188124 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Created reservations ['13134446-e63c-4007-92ae-2cb803908603', '328cc3a3-21c8-4b7a-b3c0-a3f87678051e', 'ddfb41a8-2acf-4231-a598-724c628e187c', '96e66317-7a04-47a2-b0d4-b5b5d8716281'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:34:58.191097 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:58.191097 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:58.191097 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:58.292355 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:58.371477 n-d-760454-3 sudo[2813]: pam_unix(sudo:session): session closed for user root
Jan 25 13:34:58.374128 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03" returned: 0 in 0.978s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:34:58.375712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:58.435501 n-d-760454-3 sudo[2819]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:34:58.448448 n-d-760454-3 sudo[2819]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:34:59.328755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:34:59.660043 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:34:59.660043 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:34:59.660043 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:34:59.771477 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:34:59.772498 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:34:59.815658 n-d-760454-3 sudo[2826]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:34:59.816937 n-d-760454-3 sudo[2826]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:00.051773 n-d-760454-3 sudo[2819]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:00.055027 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-7b3f511f-6059-4b05-9869-3e4479a3bf03" returned: 0 in 1.679s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:00.065293 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: 7b3f511f-6059-4b05-9869-3e4479a3bf03
Jan 25 13:35:00.333069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['c9b02ac1-3cac-4f61-8df2-ddf2b1aec3c1', 'c70273f3-d09a-4644-8c7a-ae6cdfa2a32e', 'a0fd3abc-ee86-4a10-b6a7-196f992d02b7', '8fb94157-b66b-4ea4-a412-11f036db0307'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:00.339410 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:00.339410 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:00.339410 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:00.543892 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:00.713608 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:35:00.724151 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:00.803183 n-d-760454-3 sudo[2847]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:35:00.805905 n-d-760454-3 sudo[2847]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:01.082217 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] group_snapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: deleting
Jan 25 13:35:01.165382 n-d-760454-3 sudo[2826]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:01.213970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.441s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:01.282487 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:01.312264 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] group_snapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: deleting {{(pid=89244) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4013}}
Jan 25 13:35:01.335406 n-d-760454-3 sudo[2856]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:35:01.338859 n-d-760454-3 sudo[2856]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:01.364896 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:01.419064 n-d-760454-3 sudo[2858]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0
Jan 25 13:35:01.419642 n-d-760454-3 sudo[2858]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:01.585229 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:02.467302 n-d-760454-3 sudo[2847]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:02.491596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.777s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:02.494266 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:02.578328 n-d-760454-3 sudo[2862]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:35:02.584771 n-d-760454-3 sudo[2862]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:02.637635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:03.040853 n-d-760454-3 sudo[2856]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:03.043892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.762s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:03.052254 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:35:03.068367 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a13fd319-e211-4ce6-8807-4f0e5a9bcc82 tempest-GroupSnapshotsTest-917539146 None] Delete group completed successfully.
Jan 25 13:35:03.271235 n-d-760454-3 sudo[2858]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:03.274067 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0" returned: 0 in 1.916s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:03.277331 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:03.321420 n-d-760454-3 sudo[2868]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0
Jan 25 13:35:03.330621 n-d-760454-3 sudo[2868]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:03.673319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:03.710068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:35:03.723734 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:35:03.733553 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:35:03.774574 n-d-760454-3 sudo[2862]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:03.780886 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (78c3202b-d0db-4a5e-8db2-737d833e2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:03.786577 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389be60f-ebc7-4a46-93a4-0282a53dab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:03.885791 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.392s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:03.890207 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:35:03.925892 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:35:03.950432 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:35:04.065167 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389be60f-ebc7-4a46-93a4-0282a53dab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1186041414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=ebbe4668-c1c7-4794-873e-4b6d6de7b9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:35:03Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:04.071598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd747d1e-6e87-4deb-aa5f-d649e7fa3b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:04.074908 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd747d1e-6e87-4deb-aa5f-d649e7fa3b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:04.080850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579f85b-8071-4097-8374-96dcb124ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:04.115282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-72734564-bd20-4a5b-ac51-0b11e56ff798 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-7b3f511f-6059-4b05-9869-3e4479a3bf03-delete_volume'" released by "delete_volume" :: held 8.585s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:35:04.511645 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579f85b-8071-4097-8374-96dcb124ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebbe4668-c1c7-4794-873e-4b6d6de7b9f9', 'volume_name': 'volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c30b400>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:04.525472 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9585bc09-cfbc-4379-b0ab-3c58eeb1969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:04.530309 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9585bc09-cfbc-4379-b0ab-3c58eeb1969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:04.546932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54390cd-c9a3-40b5-a289-3d48e7057e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:04.548508 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Volume ebbe4668-c1c7-4794-873e-4b6d6de7b9f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c30b400>}
Jan 25 13:35:04.549700 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Cloning ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:35:04.695613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:04.710234 n-d-760454-3 sudo[2868]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:04.714170 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ec8dafc5-6a50-43c3-8484-1bdb2a783ee0" returned: 0 in 1.437s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:05.047530 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-859268667 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-859268667, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:35:05.122291 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] Created reservations ['f94d09cc-68af-4ee4-8b29-d9db8db1a1a0', '4530ea96-b051-451d-af11-d70cd5c85e89', 'd60b5b96-0922-40ae-b647-47f2164b45bf', '12a2e1ce-12e7-417e-84cd-72b08c1ea1db'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:05.126389 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:05.126389 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:05.126389 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:05.336711 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d1386a60-0b4d-4385-b204-8e58f9ef6d1b tempest-GroupSnapshotsTest-917539146 None] group_snapshot 5d71f404-f0d6-4343-adcd-8a08010b15fc: deleted successfully
Jan 25 13:35:05.621247 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:35:05.633632 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:35:05.634573 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:35:05.668579 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Flow 'volume_create_manager' (620d7bad-8eb9-4057-a212-e8bde86200df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:05.687292 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19d450d-883c-4e9e-ae61-3f403362a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:05.746588 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:05.769712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:35:05.831204 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19d450d-883c-4e9e-ae61-3f403362a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-107462092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=8b04b729-ae44-49b8-be3c-5e5132b8878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26026d0cc6fd440ba1b33fd9148f629b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:35:05Z,user_id='a5a4aa82c8224d1098027442d4c213d5',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:05.854914 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9ec220-9935-431f-ad98-593a83f7dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:05.859605 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9ec220-9935-431f-ad98-593a83f7dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:05.862371 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c628b70d-0f32-4c6f-9fdb-61cf104e3500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:05.877543 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c628b70d-0f32-4c6f-9fdb-61cf104e3500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b04b729-ae44-49b8-be3c-5e5132b8878d', 'volume_name': 'volume-8b04b729-ae44-49b8-be3c-5e5132b8878d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:05.882534 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e63b0-39a1-4156-968b-1dcca6437ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:05.886798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e63b0-39a1-4156-968b-1dcca6437ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:05.917841 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88ac4f7-fca1-4da2-832f-5a5ec8ce6971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:05.937368 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Volume 8b04b729-ae44-49b8-be3c-5e5132b8878d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b04b729-ae44-49b8-be3c-5e5132b8878d', 'volume_size': 1}
Jan 25 13:35:05.939418 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8b04b729-ae44-49b8-be3c-5e5132b8878d stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:05.994048 n-d-760454-3 sudo[2911]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8b04b729-ae44-49b8-be3c-5e5132b8878d stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:35:05.994613 n-d-760454-3 sudo[2911]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:06.796562 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:07.001035 n-d-760454-3 sudo[2911]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:07.022615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-8b04b729-ae44-49b8-be3c-5e5132b8878d stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.084s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:07.031122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88ac4f7-fca1-4da2-832f-5a5ec8ce6971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b04b729-ae44-49b8-be3c-5e5132b8878d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:07.033852 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91284671-734f-463d-8566-fa77ad5f6662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:07.056306 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Skipping remove_export. No iscsi_target is presently exported for volume: c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:35:07.062584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:07.178426 n-d-760454-3 sudo[2942]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:35:07.179547 n-d-760454-3 sudo[2942]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:07.215160 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Volume volume-8b04b729-ae44-49b8-be3c-5e5132b8878d (8b04b729-ae44-49b8-be3c-5e5132b8878d): created successfully
Jan 25 13:35:07.220767 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91284671-734f-463d-8566-fa77ad5f6662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:07.241672 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Flow 'volume_create_manager' (620d7bad-8eb9-4057-a212-e8bde86200df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:07.318710 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1a8b4eb9-b563-40ef-9f5d-6195b486866d tempest-VolumesSnapshotListTestJSON-852151089 None] Created volume successfully.
Jan 25 13:35:07.809940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:08.253781 n-d-760454-3 sudo[2942]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:08.261324 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0" returned: 0 in 1.199s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:08.263494 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:08.301478 n-d-760454-3 sudo[2946]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:35:08.302440 n-d-760454-3 sudo[2946]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:08.444068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 35.84 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:35:08.444999 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Image download 616.00 MB at 17.19 MB/s
Jan 25 13:35:08.519167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:08.674976 n-d-760454-3 sudo[2948]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1
Jan 25 13:35:08.675719 n-d-760454-3 sudo[2948]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:08.821883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:09.045982 n-d-760454-3 sudo[2946]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:09.058335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0" returned: 0 in 0.795s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:09.061174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:09.111923 n-d-760454-3 sudo[2952]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:35:09.112488 n-d-760454-3 sudo[2952]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:09.514133 n-d-760454-3 sudo[2948]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:09.525178 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1" returned: 0 in 1.006s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:09.538083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user 253e9e6711fa4978b18bbf3697b15cbf. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:35:09.725471 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-12a562bb-c4ab-4fd2-a11d-3bcacacf0c99 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:09.760461 n-d-760454-3 sudo[2956]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:09.766690 n-d-760454-3 sudo[2956]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:09.806402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:09.891809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:10.031794 n-d-760454-3 sudo[2958]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1
Jan 25 13:35:10.032686 n-d-760454-3 sudo[2958]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:10.219398 n-d-760454-3 sudo[2952]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:10.223617 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c72195ab-8b22-4cf0-9cd2-52f66d41d1d0" returned: 0 in 1.163s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:10.225438 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Successfully deleted volume: c72195ab-8b22-4cf0-9cd2-52f66d41d1d0
Jan 25 13:35:10.569431 n-d-760454-3 sudo[2956]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:10.571716 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-12a562bb-c4ab-4fd2-a11d-3bcacacf0c99 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 0.846s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:10.580155 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-12a562bb-c4ab-4fd2-a11d-3bcacacf0c99 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:10.607495 n-d-760454-3 sudo[2970]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g
Jan 25 13:35:10.608347 n-d-760454-3 sudo[2970]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:10.638511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Created reservations ['94996701-69b1-4e53-98cf-05a54896601b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:10.682862 n-d-760454-3 sudo[2958]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:10.686715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1" returned: 0 in 0.881s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:10.688842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0a84695-2a50-47dd-a178-af956c05ae7b stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:10.724006 n-d-760454-3 sudo[2973]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0a84695-2a50-47dd-a178-af956c05ae7b stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:35:10.724668 n-d-760454-3 sudo[2973]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:10.792413 n-d-760454-3 cinder-volume[89138]: WARNING cinder.db.sqlalchemy.api [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Change will make usage less than 0 for the following resources: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-859268667']
Jan 25 13:35:10.793062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Created reservations ['4a127293-5d2b-4416-94e4-e34dd1ca9dbe', '20e39f1b-bd0b-488a-88db-9431095fcdb7', '797a8019-07b4-457f-a762-3c8f49e3bef3', '02b14160-34d1-4be3-a4d1-1e71bf6574ea'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:10.796578 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:10.796578 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:10.796578 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:10.957543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:11.196069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:35:11.196921 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:11.241536 n-d-760454-3 sudo[2977]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:35:11.243910 n-d-760454-3 sudo[2977]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:11.831532 n-d-760454-3 sudo[2970]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:11.835284 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-12a562bb-c4ab-4fd2-a11d-3bcacacf0c99 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g" returned: 0 in 1.261s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:12.077825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:12.115452 n-d-760454-3 sudo[2973]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:12.118550 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b0a84695-2a50-47dd-a178-af956c05ae7b stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.430s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:12.159219 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-12a562bb-c4ab-4fd2-a11d-3bcacacf0c99 tempest-VolumesSnapshotListTestJSON-852151089 None] Create snapshot completed successfully
Jan 25 13:35:12.190367 n-d-760454-3 sudo[2977]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:12.193479 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.996s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:12.211712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:12.254882 n-d-760454-3 sudo[3105]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:35:12.258406 n-d-760454-3 sudo[3105]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:12.276796 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume b0a84695-2a50-47dd-a178-af956c05ae7b. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:35:12.371465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmptfn26qw6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:12.664858 n-d-760454-3 sudo[3107]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmptfn26qw6
Jan 25 13:35:12.665494 n-d-760454-3 sudo[3107]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:13.175250 n-d-760454-3 sudo[3105]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:13.180408 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.969s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:13.191977 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5b5b48f0-a600-4548-8dff-b08ee5bd18f6 tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-917741051: creating
Jan 25 13:35:13.205440 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:35:13.216205 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-2426a6c0-c1f0-453f-a456-17fe91d86f31 tempest-GroupSnapshotsTest-917539146 None] Delete group completed successfully.
Jan 25 13:35:13.219343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:13.350121 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5b5b48f0-a600-4548-8dff-b08ee5bd18f6 tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-917741051: created successfully
Jan 25 13:35:13.448895 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5b5b48f0-a600-4548-8dff-b08ee5bd18f6 tempest-GroupSnapshotsTest-917539146 None] Create group completed successfully.
Jan 25 13:35:13.504793 n-d-760454-3 sudo[3107]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:13.507070 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmptfn26qw6" returned: 0 in 1.137s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:13.508201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:13.674352 n-d-760454-3 sudo[3112]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1
Jan 25 13:35:13.675325 n-d-760454-3 sudo[3112]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:14.029860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb97e524-56d1-4b68-9e1d-d48fe1f363af tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:14.097863 n-d-760454-3 sudo[3114]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:14.098750 n-d-760454-3 sudo[3114]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:14.240695 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:14.464022 n-d-760454-3 sudo[3112]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:14.467991 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1" returned: 0 in 0.959s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:14.469661 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:35:14.471363 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:14.530650 n-d-760454-3 sudo[3118]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b oflag=direct
Jan 25 13:35:14.544852 n-d-760454-3 sudo[3118]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:15.256621 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:15.554665 n-d-760454-3 sudo[3118]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:15.559246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b oflag=direct" returned: 0 in 1.088s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:15.561112 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:15.604464 n-d-760454-3 sudo[3130]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b
Jan 25 13:35:15.616301 n-d-760454-3 sudo[3130]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:15.616871 n-d-760454-3 sudo[3114]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:15.624449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb97e524-56d1-4b68-9e1d-d48fe1f363af tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 1.595s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:15.632616 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb97e524-56d1-4b68-9e1d-d48fe1f363af tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:15.685752 n-d-760454-3 sudo[3132]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g
Jan 25 13:35:15.687452 n-d-760454-3 sudo[3132]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:15.859760 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:35:15.884601 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:35:15.885882 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:35:15.901689 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (40835fca-aa94-48b3-b329-1ce2db7d8905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:15.907665 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b846c-c26f-464a-a235-c5e89a4a8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:15.940402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:35:16.033143 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b846c-c26f-464a-a235-c5e89a4a8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-179006225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=306366b7-9ab8-4f14-96c0-cbd61e852398,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=dffd027b-f32c-421a-af0e-fac8275ed60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ce7d7a17f14b329cc3f01669fb7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:35:16Z,user_id='b1985c91851b49f7add29cb07f0d5005',volume_attachment=<?>,volume_type=VolumeType(c411381f-392c-43e7-baec-a75684dfac00),volume_type_id=c411381f-392c-43e7-baec-a75684dfac00)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:16.037042 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364a4a84-c7e7-46ad-8df0-c596b70483d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:16.040214 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364a4a84-c7e7-46ad-8df0-c596b70483d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:16.044006 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14507bd3-2833-4eef-95ae-dd6965ddb008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:16.047566 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14507bd3-2833-4eef-95ae-dd6965ddb008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffd027b-f32c-421a-af0e-fac8275ed60a', 'volume_name': 'volume-dffd027b-f32c-421a-af0e-fac8275ed60a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:16.050292 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a6b5ec-35cb-43c8-94f3-5b312c424862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:16.052851 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a6b5ec-35cb-43c8-94f3-5b312c424862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:16.055632 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8f0841-2e33-44cf-816e-153011d1ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:16.095914 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Volume dffd027b-f32c-421a-af0e-fac8275ed60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffd027b-f32c-421a-af0e-fac8275ed60a', 'volume_size': 1}
Jan 25 13:35:16.097913 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-dffd027b-f32c-421a-af0e-fac8275ed60a stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:16.142658 n-d-760454-3 sudo[3134]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-dffd027b-f32c-421a-af0e-fac8275ed60a stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:35:16.143390 n-d-760454-3 sudo[3134]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:16.270442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:17.104800 n-d-760454-3 sudo[3134]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:17.106899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-dffd027b-f32c-421a-af0e-fac8275ed60a stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.009s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:17.111294 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8f0841-2e33-44cf-816e-153011d1ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffd027b-f32c-421a-af0e-fac8275ed60a', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:17.114228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3a3cd3-877e-4968-a8a8-a89fd61a2300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:17.180952 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Volume volume-dffd027b-f32c-421a-af0e-fac8275ed60a (dffd027b-f32c-421a-af0e-fac8275ed60a): created successfully
Jan 25 13:35:17.183999 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3a3cd3-877e-4968-a8a8-a89fd61a2300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:17.196938 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (40835fca-aa94-48b3-b329-1ce2db7d8905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:17.280062 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:17.557285 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-130b1a5c-7d57-4363-9cf4-4fd1f460b5d9 tempest-GroupSnapshotsTest-917539146 None] Created volume successfully.
Jan 25 13:35:17.821059 n-d-760454-3 sudo[3132]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:17.825286 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cb97e524-56d1-4b68-9e1d-d48fe1f363af tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251 --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g" returned: 0 in 2.194s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:18.301789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:18.319067 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cb97e524-56d1-4b68-9e1d-d48fe1f363af tempest-VolumesSnapshotListTestJSON-852151089 None] Create snapshot completed successfully
Jan 25 13:35:19.056904 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:35:19.063113 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:35:19.063693 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:35:19.080719 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (cb3ab3fb-5d7c-4f37-a3fd-624debd97b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:19.084283 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73273b1f-4b62-419c-9775-ee9579a88418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:19.126615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:35:19.223111 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73273b1f-4b62-419c-9775-ee9579a88418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1801244983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=306366b7-9ab8-4f14-96c0-cbd61e852398,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=9eb99a1c-5174-4359-bb1a-e1cadb92098e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ce7d7a17f14b329cc3f01669fb7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:35:19Z,user_id='b1985c91851b49f7add29cb07f0d5005',volume_attachment=<?>,volume_type=VolumeType(c411381f-392c-43e7-baec-a75684dfac00),volume_type_id=c411381f-392c-43e7-baec-a75684dfac00)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:19.227073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270c2def-b587-4224-a565-ff26869e0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:19.229639 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270c2def-b587-4224-a565-ff26869e0a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:19.232276 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce51c9b-a1ab-491b-aa72-76b93b77bf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:19.236654 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce51c9b-a1ab-491b-aa72-76b93b77bf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb99a1c-5174-4359-bb1a-e1cadb92098e', 'volume_name': 'volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:19.247279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f67aec-94d8-4615-979c-0bcde18d4456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:19.249732 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f67aec-94d8-4615-979c-0bcde18d4456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:19.252249 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e951eb-bfe2-4f4b-b5a0-e73a7560b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:19.320977 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Volume 9eb99a1c-5174-4359-bb1a-e1cadb92098e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e', 'volume_size': 1}
Jan 25 13:35:19.320977 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:19.369226 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:19.385500 n-d-760454-3 sudo[3289]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:35:19.386365 n-d-760454-3 sudo[3289]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:20.457511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:20.464107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8b85dda0-8086-4a62-aec1-a729036ee948 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:20.518995 n-d-760454-3 sudo[3293]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:20.519553 n-d-760454-3 sudo[3293]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:20.851167 n-d-760454-3 sudo[3289]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:20.859485 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.538s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:20.864144 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e951eb-bfe2-4f4b-b5a0-e73a7560b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:20.869765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60421582-acb5-40cc-ae3f-60e594b1148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:20.966489 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Volume volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e (9eb99a1c-5174-4359-bb1a-e1cadb92098e): created successfully
Jan 25 13:35:20.979536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60421582-acb5-40cc-ae3f-60e594b1148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:21.021833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (cb3ab3fb-5d7c-4f37-a3fd-624debd97b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:21.432786 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6aaa039d-eb54-4913-b90c-290eeffd4030 tempest-GroupSnapshotsTest-917539146 None] Created volume successfully.
Jan 25 13:35:21.477374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:21.491612 n-d-760454-3 sudo[3293]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:21.493644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8b85dda0-8086-4a62-aec1-a729036ee948 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 1.030s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:21.495101 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8b85dda0-8086-4a62-aec1-a729036ee948 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:21.524111 n-d-760454-3 sudo[3324]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g
Jan 25 13:35:21.525323 n-d-760454-3 sudo[3324]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:22.494891 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:22.769611 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b326ca30-e76f-49e2-a693-fdf1bf90f74a tempest-GroupSnapshotsTest-917539146 None] Update group completed successfully.
Jan 25 13:35:23.066111 n-d-760454-3 sudo[3324]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:23.068880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8b85dda0-8086-4a62-aec1-a729036ee948 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b --snapshot stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d -L 1.00g" returned: 0 in 1.574s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:23.323929 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8b85dda0-8086-4a62-aec1-a729036ee948 tempest-VolumesSnapshotListTestJSON-852151089 None] Create snapshot completed successfully
Jan 25 13:35:23.512337 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:24.284498 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a8caf2e4-cb2f-43ac-aea3-fc8dc0f1436e tempest-GroupSnapshotsTest-917539146 None] Update group completed successfully.
Jan 25 13:35:24.525137 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:25.534435 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:26.540518 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:26.630632 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-92dd91ac-a690-4825-8e27-9b7b42f0f38b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:35:26.632732 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:26.650955 n-d-760454-3 sudo[3461]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b
Jan 25 13:35:26.651498 n-d-760454-3 sudo[3461]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:26.946096 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-274924a3-57fb-4e27-b388-e16d8b8d1b87 tempest-GroupSnapshotsTest-917539146 None] Update group completed successfully.
Jan 25 13:35:27.551353 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:28.561246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:29.495099 n-d-760454-3 sudo[3461]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:30.109309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b" returned: 0 in 2.865s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:30.109309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:30.109309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:29.517890 n-d-760454-3 sudo[3465]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b
Jan 25 13:35:29.518412 n-d-760454-3 sudo[3465]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:44.959125 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 40.40 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:35:44.960173 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Image download 616.00 MB at 15.25 MB/s
Jan 25 13:35:44.999430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:45.035451 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:45.143754 n-d-760454-3 sudo[3544]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1
Jan 25 13:35:45.144277 n-d-760454-3 sudo[3544]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:45.645535 n-d-760454-3 sudo[3544]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:45.650005 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1" returned: 0 in 0.614s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:45.651436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user e05ff2642a9b43da927aa763694ac642. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:35:46.127065 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:46.224344 n-d-760454-3 sudo[3465]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:46.226502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-92dd91ac-a690-4825-8e27-9b7b42f0f38b" returned: 0 in 16.727s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:46.406204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:46.559885 n-d-760454-3 sudo[3552]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1
Jan 25 13:35:46.560456 n-d-760454-3 sudo[3552]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:46.684981 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c56df8e9-77f1-4dee-be88-14baf04dd292 tempest-GroupSnapshotsTest-917539146 None] Update group completed successfully.
Jan 25 13:35:46.687985 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Created reservations ['2d2f6185-b59a-4dc7-8d7a-1ec263bd98fa', '03193a02-dd3f-4cce-a6c9-a0365f1c4200', '825ce38f-52a5-44fa-bf06-3c3310028ab6', '76dd4d5b-8a2b-49c3-ad30-7028b81533ba'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:46.693069 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:46.693069 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:46.693069 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:46.961510 n-d-760454-3 sudo[3552]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:46.963785 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1" returned: 0 in 0.558s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:46.966227 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:46.988228 n-d-760454-3 sudo[3556]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:35:46.988831 n-d-760454-3 sudo[3556]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:47.140362 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:47.163902 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:35:47.164351 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:35:47.165199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:47.180430 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Delete snapshot completed successfully.
Jan 25 13:35:47.192101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7f0e4945-c77a-4340-899b-e76fae548635 tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-92dd91ac-a690-4825-8e27-9b7b42f0f38b-delete_snapshot'" released by "delete_snapshot" :: held 20.561s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:35:47.194842 n-d-760454-3 sudo[3558]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:35:47.195628 n-d-760454-3 sudo[3558]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:47.794511 n-d-760454-3 sudo[3558]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:47.796562 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:47.798088 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:47.821189 n-d-760454-3 sudo[3556]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:47.827211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.861s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:47.841240 n-d-760454-3 sudo[3591]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:35:47.841787 n-d-760454-3 sudo[3591]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:48.148711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:48.179874 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume ebbe4668-c1c7-4794-873e-4b6d6de7b9f9. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:35:48.227468 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp5tvws29z {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:48.311059 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-4eb5faf7-ac2f-4a52-84df-14456b79c251-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:35:48.313653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:48.345341 n-d-760454-3 sudo[3595]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp5tvws29z
Jan 25 13:35:48.345894 n-d-760454-3 sudo[3595]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:48.346642 n-d-760454-3 sudo[3596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251
Jan 25 13:35:48.347170 n-d-760454-3 sudo[3596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:48.643917 n-d-760454-3 sudo[3591]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:48.662840 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.848s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:48.662840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:35:48.775638 n-d-760454-3 sudo[3595]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:48.777907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp5tvws29z" returned: 0 in 0.551s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:48.779541 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:48.833981 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] GroupSnapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: creating.
Jan 25 13:35:48.920627 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] Group snapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: creating. {{(pid=89244) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:3846}}
Jan 25 13:35:48.995233 n-d-760454-3 sudo[3603]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1
Jan 25 13:35:48.996470 n-d-760454-3 sudo[3603]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:49.026539 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:49.067083 n-d-760454-3 sudo[3608]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:35:49.067652 n-d-760454-3 sudo[3608]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:49.162998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:49.163902 n-d-760454-3 sudo[3596]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:49.166085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251" returned: 0 in 0.852s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:49.177303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:49.261218 n-d-760454-3 sudo[3613]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251
Jan 25 13:35:49.272843 n-d-760454-3 sudo[3613]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:49.577271 n-d-760454-3 sudo[3603]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:49.579970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1" returned: 0 in 0.800s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:49.581181 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:35:49.582716 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:49.601401 n-d-760454-3 sudo[3622]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9 oflag=direct
Jan 25 13:35:49.602606 n-d-760454-3 sudo[3622]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:49.828235 n-d-760454-3 sudo[3130]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:49.835438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b" returned: 0 in 34.274s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:49.844325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:50.032612 n-d-760454-3 sudo[3608]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:50.037592 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a" returned: 0 in 1.013s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:50.039514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90 --snapshot stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:50.095712 n-d-760454-3 sudo[3676]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90 --snapshot stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a -L 1.00g
Jan 25 13:35:50.097852 n-d-760454-3 sudo[3676]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:50.208157 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:50.312093 n-d-760454-3 sudo[3634]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1
Jan 25 13:35:50.313235 n-d-760454-3 sudo[3634]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:50.357491 n-d-760454-3 sudo[3622]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:50.359910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9 oflag=direct" returned: 0 in 0.777s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:50.361433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:50.397446 n-d-760454-3 sudo[3701]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9
Jan 25 13:35:50.398114 n-d-760454-3 sudo[3701]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:50.413209 n-d-760454-3 sudo[3613]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:50.416953 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-4eb5faf7-ac2f-4a52-84df-14456b79c251" returned: 0 in 1.248s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:50.706759 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Created reservations ['279147a0-1fe1-4e9a-8d49-c13929d1ddda', '00e34943-73d9-43be-b036-cd5a8f260665', 'd76c667b-03d3-4766-8192-e6f44c23f914', 'fc9cc17e-9700-4872-a095-9fe42300add8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:50.710066 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:50.710066 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:50.710066 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:50.865389 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Delete snapshot completed successfully.
Jan 25 13:35:50.875704 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-6d578914-18f0-4ad6-a965-bb2af48a2e41 tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-4eb5faf7-ac2f-4a52-84df-14456b79c251-delete_snapshot'" released by "delete_snapshot" :: held 2.565s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:35:50.987826 n-d-760454-3 sudo[3634]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:50.990631 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1" returned: 0 in 1.147s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:50.991790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmppdb9ifhtn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 34.28 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--b0a84695--2a50--47dd--a178--af956c05ae7b {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:35:50.992435 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Converted 700.00 MB image at 20.42 MB/s
Jan 25 13:35:50.993229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume b0a84695-2a50-47dd-a178-af956c05ae7b successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:35:51.231426 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user 253e9e6711fa4978b18bbf3697b15cbf is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:35:51.232362 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Marking volume b0a84695-2a50-47dd-a178-af956c05ae7b as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:35:51.254036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:51.358352 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to b0a84695-2a50-47dd-a178-af956c05ae7b. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:35:51.359178 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Creating volume glance metadata for volume b0a84695-2a50-47dd-a178-af956c05ae7b backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:35:51.648211 n-d-760454-3 sudo[3676]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:51.651008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90 --snapshot stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a -L 1.00g" returned: 0 in 1.611s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:51.739986 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:51.797079 n-d-760454-3 sudo[3811]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:35:51.797982 n-d-760454-3 sudo[3811]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:51.958948 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e5e69-ee50-4791-b983-786e1344228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a84695-2a50-47dd-a178-af956c05ae7b', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1e2be0>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:51.962746 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d0e056-c695-48d9-a02c-c404ada398ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:35:52.010427 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-dd9258b8-3d65-4121-84f5-c0b6623e3bd0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:35:52.017693 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:52.105787 n-d-760454-3 sudo[3813]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0
Jan 25 13:35:52.112625 n-d-760454-3 sudo[3813]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:52.158206 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Volume volume-b0a84695-2a50-47dd-a178-af956c05ae7b (b0a84695-2a50-47dd-a178-af956c05ae7b): created successfully
Jan 25 13:35:52.162157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d0e056-c695-48d9-a02c-c404ada398ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:35:52.166396 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (f487b19b-ed83-4352-8eb6-6d7646c12746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:35:52.259606 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d77c09dd-a957-4d8c-b74e-7dee547283ac tempest-VolumesBackupsTest-1355027314 None] Created volume successfully.
Jan 25 13:35:52.270531 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:53.010370 n-d-760454-3 sudo[3811]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:53.013301 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e" returned: 0 in 1.276s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:53.014339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77 --snapshot stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:53.055754 n-d-760454-3 sudo[3819]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77 --snapshot stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e -L 1.00g
Jan 25 13:35:53.060991 n-d-760454-3 sudo[3819]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:53.081612 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0" returned: 0 in 1.054s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:53.081612 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:53.064109 n-d-760454-3 sudo[3813]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:53.123530 n-d-760454-3 sudo[3821]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0
Jan 25 13:35:53.126534 n-d-760454-3 sudo[3821]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:53.281554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:54.273675 n-d-760454-3 sudo[3821]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:54.276127 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd9258b8-3d65-4121-84f5-c0b6623e3bd0" returned: 0 in 1.206s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:54.418725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:54.575793 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Created reservations ['30b414fb-f747-4406-8ed2-29cf307d0759', '736c58c0-fe1e-4595-b078-4915c85ef2db', 'c85be5ae-5d1e-490e-b59a-e1ec649426d6', 'd627bb79-8f36-4f0f-833d-182f1bb8f606'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:54.577716 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:54.577716 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:54.577716 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:54.737078 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Creating a new backup for volume volume-b0a84695-2a50-47dd-a178-af956c05ae7b. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:35:54.761299 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:54.821285 n-d-760454-3 sudo[3942]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:35:54.822066 n-d-760454-3 sudo[3942]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:54.951315 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Delete snapshot completed successfully.
Jan 25 13:35:54.960275 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-534c1fe9-f6fa-43ec-bff2-022a2d314b0d tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-dd9258b8-3d65-4121-84f5-c0b6623e3bd0-delete_snapshot'" released by "delete_snapshot" :: held 2.948s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:35:55.060043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77 --snapshot stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e -L 1.00g" returned: 0 in 2.030s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:55.042350 n-d-760454-3 sudo[3819]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:55.380170 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:55.511915 n-d-760454-3 sudo[3942]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:55.514695 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b" returned: 0 in 0.753s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:55.567860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:55.577033 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.010s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:55.577595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:35:55.578885 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:35:55.580324 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-b0a84695-2a50-47dd-a178-af956c05ae7b,
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b>
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:     incominguser HBfh8Ypc4CNCLcEdqvfR Qtcr5BwFLXB5656K
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:35:55.887153 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:35:55.893521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:56.319355 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-8b04b729-ae44-49b8-be3c-5e5132b8878d-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:35:56.390393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:56.440256 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b" returned: 0 in 0.533s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:56.441044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:35:56.469591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:35:56.470102 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.033s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Skipping remove_export. No iscsi_target is presently exported for volume: 8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:56.514305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:56.559620 n-d-760454-3 sudo[4009]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:56.560190 n-d-760454-3 sudo[4009]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:56.644863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.136s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:56.645513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:35:56.647872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:56.660618 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-10fe9a18-f546-4d24-95da-6157c6b0d130 tempest-GroupSnapshotsTest-917539146 None] group_snapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: created successfully
Jan 25 13:35:56.831932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.169s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:56.831932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:35:56.831932 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:35:57.117654 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Initialize volume connection completed successfully.
Jan 25 13:35:57.368589 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] group_snapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: deleting
Jan 25 13:35:57.420204 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] group_snapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: deleting {{(pid=89244) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4013}}
Jan 25 13:35:57.426841 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:57.437503 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:57.468340 n-d-760454-3 sudo[4022]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90
Jan 25 13:35:57.469672 n-d-760454-3 sudo[4022]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:57.525671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 0.994s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:57.525671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:57.503064 n-d-760454-3 sudo[4009]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:57.530610 n-d-760454-3 sudo[4035]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:57.531677 n-d-760454-3 sudo[4035]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:58.170292 n-d-760454-3 sudo[4035]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:58.172990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:58.175795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:58.194788 n-d-760454-3 sudo[4087]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:58.195596 n-d-760454-3 sudo[4087]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:58.281663 n-d-760454-3 sudo[4022]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:58.302970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90" returned: 0 in 0.846s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:58.302970 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:58.303548 n-d-760454-3 sudo[4089]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90
Jan 25 13:35:58.304256 n-d-760454-3 sudo[4089]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:58.441744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:58.893584 n-d-760454-3 sudo[4087]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:58.895765 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-8b04b729-ae44-49b8-be3c-5e5132b8878d" returned: 0 in 0.720s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:58.899629 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Successfully deleted volume: 8b04b729-ae44-49b8-be3c-5e5132b8878d
Jan 25 13:35:59.128715 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Created reservations ['9db06b4a-d867-4286-b19d-27c7557e1927', '15c8f88b-d06f-4d6a-88e9-55b66453dfef', '559fc90d-c8b4-4497-a48c-e52f886ace15', '70e7adf8-1c59-4763-95fe-596b99ebc017'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:35:59.146157 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:35:59.146157 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:35:59.146157 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:35:59.245894 n-d-760454-3 sudo[4089]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:59.248671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-306beb97-7678-4ea9-a947-0f0d253d3c90" returned: 0 in 0.962s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:59.250448 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:59.271770 n-d-760454-3 sudo[4150]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77
Jan 25 13:35:59.272439 n-d-760454-3 sudo[4150]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:59.358305 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:35:59.359405 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:59.382168 n-d-760454-3 sudo[4152]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:35:59.382743 n-d-760454-3 sudo[4152]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:35:59.457002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:35:59.802815 n-d-760454-3 sudo[4152]: pam_unix(sudo:session): session closed for user root
Jan 25 13:35:59.804847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:35:59.806393 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:35:59.827385 n-d-760454-3 sudo[4158]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:35:59.827939 n-d-760454-3 sudo[4158]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:00.193275 n-d-760454-3 sudo[4150]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:00.195632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77" returned: 0 in 0.945s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:00.197699 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:00.215121 n-d-760454-3 sudo[4161]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77
Jan 25 13:36:00.215662 n-d-760454-3 sudo[4161]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:00.470631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:00.554741 n-d-760454-3 sudo[4158]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:00.557635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.751s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:00.562587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:36:00.588417 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Deleted volume successfully.
Jan 25 13:36:00.782625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-03ca14c2-042c-4f56-af2b-1a1e1c415a5e tempest-VolumesSnapshotListTestJSON-852151089 None] Lock "b'cinder-8b04b729-ae44-49b8-be3c-5e5132b8878d-delete_volume'" released by "delete_volume" :: held 4.463s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:36:01.119446 n-d-760454-3 sudo[4161]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:01.121481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-af0285e5-2aa5-4542-8578-174eba8a9e77" returned: 0 in 0.924s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:01.475809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:02.139590 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-586204713 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-586204713, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:02.141670 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-586204713 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-586204713, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:02.259990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Created reservations ['b4cb02e0-37b7-45ef-9a68-c7a1e99afca9', '25d49596-e941-4e3e-85ab-53e291028fa6', 'd259809f-be5d-4794-8986-c28b84dc1664', '075d16b0-6171-49aa-883f-8efebdad9912'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:02.263399 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:02.263399 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:02.263399 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:02.483183 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:03.105524 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] Created reservations ['f47d264c-db6f-4683-b445-20a226131a7e', '8643d392-a6b2-47a6-adb1-e0c5d160ae87', 'cad01a27-b2da-4bc9-ab1b-2f34acbb9ada', '19ffb7fd-935d-4f79-bfcc-aa377a777309'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:03.107401 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:03.107401 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:03.107401 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:03.459096 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-0e1ffc6f-8600-46cc-bb97-f7500fccb90f tempest-GroupSnapshotsTest-917539146 None] group_snapshot 53b280ac-2a25-41d9-8fef-9c54192bc323: deleted successfully
Jan 25 13:36:03.491354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:04.481918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Skipping remove_export. No iscsi_target is presently exported for volume: 9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:36:04.483420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:04.504289 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:04.511520 n-d-760454-3 sudo[4209]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:36:04.512090 n-d-760454-3 sudo[4209]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:05.511498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:05.664984 n-d-760454-3 sudo[4209]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:05.670089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e" returned: 0 in 1.186s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:05.673467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:05.735059 n-d-760454-3 sudo[4213]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:36:05.735680 n-d-760454-3 sudo[4213]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:06.442588 n-d-760454-3 sudo[4213]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:06.445660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e" returned: 0 in 0.773s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:06.448963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:06.495742 n-d-760454-3 sudo[4223]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:36:06.500733 n-d-760454-3 sudo[4223]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:06.521792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:07.365997 n-d-760454-3 sudo[4223]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:07.371444 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9eb99a1c-5174-4359-bb1a-e1cadb92098e" returned: 0 in 0.923s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:07.376168 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Successfully deleted volume: 9eb99a1c-5174-4359-bb1a-e1cadb92098e
Jan 25 13:36:07.377046 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Skipping remove_export. No iscsi_target is presently exported for volume: dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:36:07.377968 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:07.406347 n-d-760454-3 sudo[4232]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:36:07.407212 n-d-760454-3 sudo[4232]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:07.529020 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:08.197664 n-d-760454-3 sudo[4232]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:08.200093 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a" returned: 0 in 0.822s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:08.201563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:08.238195 n-d-760454-3 sudo[4246]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:36:08.238744 n-d-760454-3 sudo[4246]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:08.566010 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:08.675848 n-d-760454-3 sudo[4246]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:08.677783 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a" returned: 0 in 0.476s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:08.679357 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:08.697794 n-d-760454-3 sudo[4252]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:36:08.698842 n-d-760454-3 sudo[4252]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:09.309964 n-d-760454-3 sudo[4252]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:09.313089 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-dffd027b-f32c-421a-af0e-fac8275ed60a" returned: 0 in 0.632s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:09.315609 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Successfully deleted volume: dffd027b-f32c-421a-af0e-fac8275ed60a
Jan 25 13:36:09.556268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:09.825273 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Created reservations ['de924aa7-aba0-4490-b8f6-1b6b53af1ff6'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:09.862571 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-586204713 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-586204713, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:10.030391 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Created reservations ['b6a01f1f-8d99-4422-b04b-4878a3292f87', 'ee020cad-dc2c-4213-9121-55b8f4276c63', '3b14285e-64f0-4c5e-862d-d2b10218e544', '7fbde656-c778-4363-9567-5ff5019e77f9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:10.033775 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:10.033775 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:10.033775 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:10.561910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:10.584891 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Created reservations ['7eb1e440-8de5-4f1b-9096-010db7c8e827', 'ddeeebd9-cfcb-4167-9fe6-24d4924ad1b1', '36e967e8-da86-4a31-a778-1a93dd7f9c87', '1cae6acd-5590-45f0-bd59-4509e561faec'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:11.270829 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:36:11.291188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:11.288441 n-d-760454-3 sudo[4273]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:36:11.288978 n-d-760454-3 sudo[4273]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:11.569940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:11.687849 n-d-760454-3 sudo[4273]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:11.690502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:11.692404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:11.713243 n-d-760454-3 sudo[4283]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:36:11.714958 n-d-760454-3 sudo[4283]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:12.558282 n-d-760454-3 sudo[4283]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:12.561009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.868s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:12.563671 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:36:12.583411 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-327b2f38-7ae8-4b38-b6ac-29913b142b2e tempest-GroupSnapshotsTest-917539146 None] Delete group completed successfully.
Jan 25 13:36:12.588255 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:12.629444 n-d-760454-3 sudo[3701]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:12.631662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9" returned: 0 in 22.270s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:12.633185 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:12.775856 n-d-760454-3 sudo[4298]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1
Jan 25 13:36:12.776394 n-d-760454-3 sudo[4298]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:13.123487 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1af38826-9341-4416-8d74-668d1f66e16f tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-1583163115: creating
Jan 25 13:36:13.236900 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1af38826-9341-4416-8d74-668d1f66e16f tempest-GroupSnapshotsTest-917539146 None] Group tempest-GroupSnapshotsTest-Group-1583163115: created successfully
Jan 25 13:36:13.272344 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1af38826-9341-4416-8d74-668d1f66e16f tempest-GroupSnapshotsTest-917539146 None] Create group completed successfully.
Jan 25 13:36:13.292851 n-d-760454-3 sudo[4298]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:13.294749 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1" returned: 0 in 0.662s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:13.297261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpy3q4m7qjn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 22.27 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--ebbe4668--c1c7--4794--873e--4b6d6de7b9f9 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:36:13.297261 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Converted 700.00 MB image at 31.43 MB/s
Jan 25 13:36:13.297261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:36:13.443528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user e05ff2642a9b43da927aa763694ac642 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:36:13.444411 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Marking volume ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:36:13.487394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to ebbe4668-c1c7-4794-873e-4b6d6de7b9f9. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:36:13.488143 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Creating volume glance metadata for volume ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:36:13.601253 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:13.702228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54390cd-c9a3-40b5-a289-3d48e7057e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c30b400>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:13.705353 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ce0061-0048-4468-b254-6b525425a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:13.755943 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 (ebbe4668-c1c7-4794-873e-4b6d6de7b9f9): created successfully
Jan 25 13:36:13.758612 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ce0061-0048-4468-b254-6b525425a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:13.763821 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (78c3202b-d0db-4a5e-8db2-737d833e2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:13.802430 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e6fe4260-2391-4d13-aa02-e5550fa89208 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:36:14.609691 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:15.450253 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:36:15.455900 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:36:15.456452 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:36:15.510866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (2f543fb8-8ffd-4c90-8499-0bc5a5f4c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:15.514995 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbed8cc-3620-4f8b-98f2-f4799741a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:15.541906 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:36:15.579915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbed8cc-3620-4f8b-98f2-f4799741a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2025967266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1ddf355-23f2-4703-b3db-db9e73f3b5b0,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ce7d7a17f14b329cc3f01669fb7bd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:36:15Z,user_id='b1985c91851b49f7add29cb07f0d5005',volume_attachment=<?>,volume_type=VolumeType(51970b12-e6b5-46dd-aa8a-f1e2ee0baccc),volume_type_id=51970b12-e6b5-46dd-aa8a-f1e2ee0baccc)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:15.584356 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80acf6b-0b88-4acc-8cd9-5c8df34fd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:15.586893 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80acf6b-0b88-4acc-8cd9-5c8df34fd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:15.590488 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1898641-43f6-472e-bbe4-6fec02d4a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:15.593954 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1898641-43f6-472e-bbe4-6fec02d4a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1', 'volume_name': 'volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:15.597997 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df90b08f-bede-41a8-9090-9d41112fad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:15.601469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df90b08f-bede-41a8-9090-9d41112fad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:15.604328 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53801d5-a739-4614-927d-a2d583fee790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:15.631155 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:15.646018 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Volume ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1', 'volume_size': 1}
Jan 25 13:36:15.647746 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:15.688642 n-d-760454-3 sudo[4306]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:36:15.690178 n-d-760454-3 sudo[4306]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:16.510714 n-d-760454-3 sudo[4306]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:16.514434 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.866s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:16.519121 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53801d5-a739-4614-927d-a2d583fee790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:16.521849 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4293eef-db7a-4c97-85bf-ef107976aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:16.584501 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Volume volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 (ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1): created successfully
Jan 25 13:36:16.587009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4293eef-db7a-4c97-85bf-ef107976aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:16.594772 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Flow 'volume_create_manager' (2f543fb8-8ffd-4c90-8499-0bc5a5f4c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:16.624795 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d3eff72c-9749-4ee0-97d8-fa8ceba69d8f tempest-GroupSnapshotsTest-917539146 None] Created volume successfully.
Jan 25 13:36:16.640604 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:17.193130 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] GroupSnapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: creating.
Jan 25 13:36:17.251000 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] Group snapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: creating. {{(pid=89244) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:3846}}
Jan 25 13:36:17.322304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:17.353635 n-d-760454-3 sudo[4337]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:17.357161 n-d-760454-3 sudo[4337]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:17.649916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:18.256265 n-d-760454-3 sudo[4337]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:18.258331 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1" returned: 0 in 0.936s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:18.260342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d --snapshot stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:18.302284 n-d-760454-3 sudo[4341]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d --snapshot stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 -L 1.00g
Jan 25 13:36:18.303361 n-d-760454-3 sudo[4341]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:18.658781 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:19.468604 n-d-760454-3 sudo[4341]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:19.470925 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d --snapshot stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 -L 1.00g" returned: 0 in 1.211s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:19.693154 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:19.748175 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-001a7d0f-6357-4b91-8cac-992c9d654725 tempest-GroupSnapshotsTest-917539146 None] group_snapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: created successfully
Jan 25 13:36:20.700445 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:21.009367 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] group_snapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: deleting
Jan 25 13:36:21.081429 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] group_snapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: deleting {{(pid=89244) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4013}}
Jan 25 13:36:21.105745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:21.145979 n-d-760454-3 sudo[4445]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d
Jan 25 13:36:21.146538 n-d-760454-3 sudo[4445]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:21.709487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:21.801424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:21.847042 n-d-760454-3 sudo[4471]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:36:21.853332 n-d-760454-3 sudo[4471]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:22.078624 n-d-760454-3 sudo[4445]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:22.081074 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d" returned: 0 in 0.975s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:22.083275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:22.126047 n-d-760454-3 sudo[4475]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d
Jan 25 13:36:22.128974 n-d-760454-3 sudo[4475]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:22.726770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:22.845991 n-d-760454-3 sudo[4471]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:22.849031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 1.048s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:23.077082 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:23.099166 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.035s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:23.099531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 34\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 34
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         HBfh8Ypc4CNCLcEdqvfR
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:36:23.100208 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:36:23.103420 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9,
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9>
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:     incominguser DhKBCs3PktGFGEK35zeE McWcti7B9okBDW7Y
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:36:23.200820 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:36:23.203350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:23.384688 n-d-760454-3 sudo[4475]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:23.387858 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-5df0f8b2-1991-4ed0-accf-e98009c1834d" returned: 0 in 1.305s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:23.614719 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-332608591 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-332608591, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:23.615657 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-332608591 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-332608591, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:23.699265 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] Created reservations ['92e497cc-abac-430c-ad50-5d0fead7d2a6', 'ec0747c4-7141-4091-95c1-5634e1e46dfb', '9f84f5c3-1ddf-4a34-9414-aebe89bbe53d', 'cf2d040b-9189-4ad4-8229-a66a32e36d5c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:23.701252 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:23.701252 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:23.701252 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:23.734039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:23.928393 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7db59de0-6bff-45c5-bcaf-2ede6df1e735 tempest-GroupSnapshotsTest-917539146 None] group_snapshot f1e636ba-56b3-4d04-9772-cb74dae3e4a6: deleted successfully
Jan 25 13:36:24.037038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 0.833s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:24.037766 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:36:24.038508 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:36:24.039171 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:36:24.042201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:24.062907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.021s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:24.063590 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 34\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 34
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         HBfh8Ypc4CNCLcEdqvfR
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:36:24.064462 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:36:24.072008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:24.207247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.134s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:24.207980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 34\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:36:24.210041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:24.446351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.236s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:24.446939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355624]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 34\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:36:24.449436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:36:24.858021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:25.014024 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-45181535-20f6-486a-bff4-e4e384af50ca req-67310000-f08b-48ed-8d7f-8432f8683aca tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:36:25.373124 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Skipping remove_export. No iscsi_target is presently exported for volume: ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:25.376452 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:25.452664 n-d-760454-3 sudo[4648]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:25.457458 n-d-760454-3 sudo[4648]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:25.866726 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:26.831601 n-d-760454-3 sudo[4648]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:26.834123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1" returned: 0 in 1.458s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:26.835249 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:26.883066 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:26.895906 n-d-760454-3 sudo[4693]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:26.902240 n-d-760454-3 sudo[4693]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:27.559699 n-d-760454-3 sudo[4693]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:27.561956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1" returned: 0 in 0.727s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:27.564205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:27.593662 n-d-760454-3 sudo[4723]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:27.594845 n-d-760454-3 sudo[4723]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:27.895036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:28.581277 n-d-760454-3 sudo[4723]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:28.583173 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1" returned: 0 in 1.019s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:28.584460 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Successfully deleted volume: ad8dcb78-5922-4e61-b33f-bfa1e3fa24a1
Jan 25 13:36:28.917864 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:28.932976 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Created reservations ['bd2aa107-1383-4f4f-9155-e3952a6b362e'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:29.020950 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-332608591 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-332608591, it is now deprecated. Please use the default quota class for default quota.
Jan 25 13:36:29.081631 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Created reservations ['5db86c1f-9c18-468c-9ea4-612b171ae779', '14f04a87-b624-43eb-835a-f16b96b431ab', 'acf975b6-25c6-4562-ba46-163e6bb8c5c6', '3f4ef0de-c02f-409f-9b6d-f10c242f30ac'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:29.084756 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:29.084756 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:29.084756 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:29.383946 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:36:29.383946 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:29.405525 n-d-760454-3 sudo[4750]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:36:29.406214 n-d-760454-3 sudo[4750]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:29.913863 n-d-760454-3 sudo[4750]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:29.916746 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:29.927665 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:29.962248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:29.973541 n-d-760454-3 sudo[4754]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:36:29.974859 n-d-760454-3 sudo[4754]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:30.759859 n-d-760454-3 sudo[4754]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:30.767994 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.840s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:30.769339 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:36:30.774754 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8e00b367-baa9-4e41-a195-743bdca6e1dc tempest-GroupSnapshotsTest-917539146 None] Delete group completed successfully.
Jan 25 13:36:30.970783 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:31.981956 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:32.988573 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:33.996124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:35.005154 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:36.014968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:37.021607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:38.029216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:39.041527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:39.509927 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:36:39.520022 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:36:39.521045 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:36:39.541099 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Flow 'volume_create_manager' (6d87d8fe-84bb-477a-af65-a9194dee7899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:39.548091 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb64ad29-7979-4a93-9934-3f8480f78ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:39.586584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:36:39.630881 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb64ad29-7979-4a93-9934-3f8480f78ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1652941285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c4684a5e-533b-4edb-b685-ae4cffa56d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08402df404514ce5a63aaa795ce2b5c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:36:39Z,user_id='8e00c87357da4f008e44bd13479e6f62',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:39.635326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf36530-0095-413e-846e-fc3ba752893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:39.638366 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf36530-0095-413e-846e-fc3ba752893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:39.641692 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df05e0fc-ccdc-48b2-938d-066bfcf0713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:39.645206 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df05e0fc-ccdc-48b2-938d-066bfcf0713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4684a5e-533b-4edb-b685-ae4cffa56d71', 'volume_name': 'volume-c4684a5e-533b-4edb-b685-ae4cffa56d71', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:39.648711 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c25871-1dfe-4417-ae9c-6afd2c83d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:39.651977 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c25871-1dfe-4417-ae9c-6afd2c83d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:39.654312 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57429f98-d780-4e23-adbc-c24872df3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:39.655217 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Volume c4684a5e-533b-4edb-b685-ae4cffa56d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4684a5e-533b-4edb-b685-ae4cffa56d71', 'volume_size': 1}
Jan 25 13:36:39.656362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:39.675905 n-d-760454-3 sudo[4791]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:36:39.676455 n-d-760454-3 sudo[4791]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:40.053927 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:40.438439 n-d-760454-3 sudo[4791]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:40.443297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.784s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:40.451034 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57429f98-d780-4e23-adbc-c24872df3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4684a5e-533b-4edb-b685-ae4cffa56d71', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:40.454542 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4e06d4-d07f-4051-a985-9dc1a5c1a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:40.521544 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Volume volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 (c4684a5e-533b-4edb-b685-ae4cffa56d71): created successfully
Jan 25 13:36:40.524382 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4e06d4-d07f-4051-a985-9dc1a5c1a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:40.529384 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Flow 'volume_create_manager' (6d87d8fe-84bb-477a-af65-a9194dee7899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:40.559931 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-78600b8d-37f3-4880-a853-2661df566d50 tempest-VolumesServicesTestJSON-348572590 None] Created volume successfully.
Jan 25 13:36:41.075402 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:41.185731 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Lock "b'cinder-c4684a5e-533b-4edb-b685-ae4cffa56d71-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:36:41.319208 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Skipping remove_export. No iscsi_target is presently exported for volume: c4684a5e-533b-4edb-b685-ae4cffa56d71
Jan 25 13:36:41.320513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:41.363522 n-d-760454-3 sudo[4822]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71
Jan 25 13:36:41.365516 n-d-760454-3 sudo[4822]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:42.086227 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:42.233306 n-d-760454-3 sudo[4822]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:42.235587 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71" returned: 0 in 0.915s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:42.237465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:42.271259 n-d-760454-3 sudo[4836]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71
Jan 25 13:36:42.272467 n-d-760454-3 sudo[4836]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:42.880467 n-d-760454-3 sudo[4836]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:42.883698 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71" returned: 0 in 0.646s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:42.895706 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:42.941625 n-d-760454-3 sudo[4841]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71
Jan 25 13:36:42.942801 n-d-760454-3 sudo[4841]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:43.106920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:44.006985 n-d-760454-3 sudo[4841]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:44.009566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c4684a5e-533b-4edb-b685-ae4cffa56d71" returned: 0 in 1.118s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:44.011490 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Successfully deleted volume: c4684a5e-533b-4edb-b685-ae4cffa56d71
Jan 25 13:36:44.093498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Created reservations ['3c2528e0-8b30-413a-b37d-61115c044885', 'b5445900-bd32-4b3c-94fb-f0e5fb9d42b0', '370ee336-295d-410a-950c-3c8c0c95f697', 'b8a9b9ac-2b70-4dd2-a2c3-d5bf4930c2b2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:36:44.101712 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:36:44.101712 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:36:44.101712 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:36:44.136398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:44.298110 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:36:44.301569 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:44.338519 n-d-760454-3 sudo[4850]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:36:44.347187 n-d-760454-3 sudo[4850]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:44.530661 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea6c5d71-fe47-4b8d-9aeb-3bd1231da20f req-a23b9378-66ac-4f2f-8d81-253bb321c2cb tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:44.553576 n-d-760454-3 sudo[4852]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:36:44.554723 n-d-760454-3 sudo[4852]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:45.019795 n-d-760454-3 sudo[4850]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:45.033196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:45.035123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:45.086447 n-d-760454-3 sudo[4876]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:36:45.087603 n-d-760454-3 sudo[4876]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:45.144026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:45.716604 n-d-760454-3 sudo[4852]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:45.718724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea6c5d71-fe47-4b8d-9aeb-3bd1231da20f req-a23b9378-66ac-4f2f-8d81-253bb321c2cb tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 1.188s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:45.719773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea6c5d71-fe47-4b8d-9aeb-3bd1231da20f req-a23b9378-66ac-4f2f-8d81-253bb321c2cb tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 --snapshot stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:45.764508 n-d-760454-3 sudo[4882]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 --snapshot stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 -L 1.00g
Jan 25 13:36:45.767140 n-d-760454-3 sudo[4882]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:46.058678 n-d-760454-3 sudo[4876]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:46.062528 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.027s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:46.066047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:36:46.083284 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Deleted volume successfully.
Jan 25 13:36:46.172207 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:46.174967 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-27d8baa2-a4de-4e7c-be8a-32b822c48086 tempest-VolumesServicesTestJSON-348572590 None] Lock "b'cinder-c4684a5e-533b-4edb-b685-ae4cffa56d71-delete_volume'" released by "delete_volume" :: held 4.989s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:36:47.161253 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:36:47.164853 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:36:47.166506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:47.247534 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:47.230936 n-d-760454-3 sudo[4972]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:36:47.231723 n-d-760454-3 sudo[4972]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:47.837555 n-d-760454-3 sudo[4882]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:47.840411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ea6c5d71-fe47-4b8d-9aeb-3bd1231da20f req-a23b9378-66ac-4f2f-8d81-253bb321c2cb tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 --snapshot stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 -L 1.00g" returned: 0 in 2.120s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:47.909356 n-d-760454-3 sudo[4972]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:47.926150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.759s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:47.928502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:47.991565 n-d-760454-3 sudo[4992]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:36:47.993392 n-d-760454-3 sudo[4992]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:48.242916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:48.261620 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ea6c5d71-fe47-4b8d-9aeb-3bd1231da20f req-a23b9378-66ac-4f2f-8d81-253bb321c2cb tempest-TestVolumeBootPattern-1757403332 None] Create snapshot completed successfully
Jan 25 13:36:49.012177 n-d-760454-3 sudo[4992]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:49.014661 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.086s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:49.016047 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:36:49.250290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:50.257055 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:51.272957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:52.283543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:53.288249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:54.298540 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:55.307259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:56.315543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:57.331904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:57.648503 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:36:57.656099 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:36:57.657062 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:36:57.728512 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (cd1cb43e-4e7b-43a4-b1d5-5a9831333d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:36:57.732740 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958cd52d-68b8-4f37-9f25-09d7678a9a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:57.787872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:36:57.830054 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958cd52d-68b8-4f37-9f25-09d7678a9a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:36:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=508ab26c-20f7-461d-b7a2-7af2110fd1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51d5182f-27c1-43fc-a61f-c86ac546d137,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:36:58Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:57.834900 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4105ae53-de77-41e6-9bd1-b358a52db849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:57.845269 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4105ae53-de77-41e6-9bd1-b358a52db849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:57.848209 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2a791d-5115-4b57-bf5f-9bc2cbf9cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:57.851614 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2a791d-5115-4b57-bf5f-9bc2cbf9cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '508ab26c-20f7-461d-b7a2-7af2110fd1b2', 'volume_name': 'volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2', 'volume_size': 1, 'snapshot_id': '51d5182f-27c1-43fc-a61f-c86ac546d137'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:57.855231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ade088b-d62c-491d-9aeb-69517ab145df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:57.858566 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ade088b-d62c-491d-9aeb-69517ab145df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:36:57.861597 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e8315d-6a68-4cdb-bca4-82fa4ea2f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:36:57.862594 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Volume 508ab26c-20f7-461d-b7a2-7af2110fd1b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2', 'volume_size': 1, 'snapshot_id': '51d5182f-27c1-43fc-a61f-c86ac546d137'}
Jan 25 13:36:57.948671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:58.008608 n-d-760454-3 sudo[5010]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:36:58.012019 n-d-760454-3 sudo[5010]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:36:58.351792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:59.364655 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:36:59.675420 n-d-760454-3 sudo[5010]: pam_unix(sudo:session): session closed for user root
Jan 25 13:36:59.678059 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.729s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:36:59.695319 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:36:59.751207 n-d-760454-3 sudo[5045]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137
Jan 25 13:36:59.752122 n-d-760454-3 sudo[5045]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:00.375089 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:00.596756 n-d-760454-3 sudo[5045]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:00.599711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137" returned: 0 in 0.920s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:00.604465 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:00.665008 n-d-760454-3 sudo[5059]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 iflag=direct
Jan 25 13:37:00.667481 n-d-760454-3 sudo[5059]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:01.388003 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:01.570237 n-d-760454-3 sudo[5059]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:01.573143 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 iflag=direct" returned: 0 in 0.970s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:01.575231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:01.616349 n-d-760454-3 sudo[5076]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 oflag=direct
Jan 25 13:37:01.616955 n-d-760454-3 sudo[5076]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:02.413289 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:02.931072 n-d-760454-3 sudo[5076]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:02.935533 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 oflag=direct" returned: 0 in 1.360s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:02.936904 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:02.986057 n-d-760454-3 sudo[5091]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:37:02.986718 n-d-760454-3 sudo[5091]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:03.408872 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:04.418269 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:05.429892 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:06.436047 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:07.447827 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:08.453619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:09.460721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:10.469511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:11.475339 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:12.481482 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:13.493272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:14.500919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:14.515337 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:37:14.527043 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:37:14.527745 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:37:14.544648 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Flow 'volume_create_manager' (3258dd0b-67a7-4ac5-a804-c4c54ef15fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:37:14.549099 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef59e84-6490-410a-a0f9-62debc2a3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:37:14.590443 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:37:14.637388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef59e84-6490-410a-a0f9-62debc2a3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1150501310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=2a2285cf-8555-46b8-b02c-bd5c7f728103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa6973a14cd4d71b27ad2a4567b5d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:37:14Z,user_id='afaac1630ea84f168b663fa86bab3b4d',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:37:14.646101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c060ad-517b-45b5-9edd-779ca2506254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:37:14.646101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c060ad-517b-45b5-9edd-779ca2506254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:37:14.646101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584d2ab5-f9c6-42cc-a647-b7d24a113a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:37:14.817276 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584d2ab5-f9c6-42cc-a647-b7d24a113a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a2285cf-8555-46b8-b02c-bd5c7f728103', 'volume_name': 'volume-2a2285cf-8555-46b8-b02c-bd5c7f728103', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c401470>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:37:14.820415 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5f3c8d-a0f1-44bd-ae58-43d53b13c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:37:14.824373 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5f3c8d-a0f1-44bd-ae58-43d53b13c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:37:14.828597 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f60dbe-e3da-43bf-872f-f0396c765993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:37:14.828597 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Volume 2a2285cf-8555-46b8-b02c-bd5c7f728103: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a2285cf-8555-46b8-b02c-bd5c7f728103', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c401470>}
Jan 25 13:37:14.829336 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Cloning 2a2285cf-8555-46b8-b02c-bd5c7f728103 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:37:15.516732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:16.522456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:17.530445 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:18.542139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:19.596509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:20.781215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:22.650385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:23.585444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:24.593573 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:25.608317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:26.615550 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:27.624995 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:28.635486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:29.653378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:30.667910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:31.676323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:32.685313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:33.703581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:34.781300 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:37.627557 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1, size 616.00 MB, duration 22.80 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:37:37.628798 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Image download 616.00 MB at 27.02 MB/s
Jan 25 13:37:37.643979 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:37.685863 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:37.791166 n-d-760454-3 sudo[5332]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1
Jan 25 13:37:37.791773 n-d-760454-3 sudo[5332]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:38.383750 n-d-760454-3 sudo[5332]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:38.386984 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1" returned: 0 in 0.701s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:38.388964 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user afaac1630ea84f168b663fa86bab3b4d. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:37:38.595326 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:38.655953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:38.720236 n-d-760454-3 sudo[5336]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1
Jan 25 13:37:38.721887 n-d-760454-3 sudo[5336]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:39.252294 n-d-760454-3 sudo[5336]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:39.255276 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1" returned: 0 in 0.660s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:39.257865 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:39.277402 n-d-760454-3 sudo[5340]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:37:39.278531 n-d-760454-3 sudo[5340]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:39.668124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:40.471885 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.204s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:40.458989 n-d-760454-3 sudo[5340]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:40.594591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 2a2285cf-8555-46b8-b02c-bd5c7f728103. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:37:40.658622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp8tvcq34f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:40.691679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:40.776640 n-d-760454-3 sudo[5371]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp8tvcq34f
Jan 25 13:37:40.777225 n-d-760454-3 sudo[5371]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:41.218904 n-d-760454-3 sudo[5371]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:41.221497 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp8tvcq34f" returned: 0 in 0.563s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:41.223273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:41.353884 n-d-760454-3 sudo[5374]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1
Jan 25 13:37:41.354572 n-d-760454-3 sudo[5374]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:41.711428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:41.752962 n-d-760454-3 sudo[5374]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:41.756520 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1" returned: 0 in 0.533s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:41.758223 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:37:41.759974 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:41.790986 n-d-760454-3 sudo[5388]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103 oflag=direct
Jan 25 13:37:41.791869 n-d-760454-3 sudo[5388]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:42.328864 n-d-760454-3 sudo[5388]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:42.331780 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103 oflag=direct" returned: 0 in 0.571s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:42.333565 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:42.358016 n-d-760454-3 sudo[5394]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103
Jan 25 13:37:42.358760 n-d-760454-3 sudo[5394]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:42.719988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:43.726637 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:44.736991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:45.747478 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:46.759398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:47.162686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:37:47.163356 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:37:47.164448 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:47.185827 n-d-760454-3 sudo[5424]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:37:47.186748 n-d-760454-3 sudo[5424]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:47.768856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:47.959260 n-d-760454-3 sudo[5424]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:47.962048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.797s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:47.964106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:37:48.025861 n-d-760454-3 sudo[5428]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:37:48.026751 n-d-760454-3 sudo[5428]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:37:48.780965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:49.204180 n-d-760454-3 sudo[5428]: pam_unix(sudo:session): session closed for user root
Jan 25 13:37:49.207243 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.243s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:37:49.210390 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:37:49.790392 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:50.798805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:51.806666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:52.813937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:53.828286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:54.855681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:55.862836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:56.869697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:57.880740 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:58.891262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:37:59.925596 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:00.930842 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:01.937286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:02.945060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:03.955656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:04.963779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:05.972820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:06.121966 n-d-760454-3 sudo[5091]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:06.124342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 63.188s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:06.125120 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--51d5182f--27c1--43fc--a61f--c86ac546d137, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--508ab26c--20f7--461d--b7a2--7af2110fd1b2, size 1024.00 MB, duration 63.19 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:38:06.125716 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Volume copy 1024.00 MB at 16.21 MB/s
Jan 25 13:38:06.228747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Marking volume 508ab26c-20f7-461d-b7a2-7af2110fd1b2 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:38:06.307952 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from snapshot 51d5182f-27c1-43fc-a61f-c86ac546d137 to 508ab26c-20f7-461d-b7a2-7af2110fd1b2. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:418}}
Jan 25 13:38:06.484356 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e8315d-6a68-4cdb-bca4-82fa4ea2f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2', 'volume_size': 1, 'snapshot_id': '51d5182f-27c1-43fc-a61f-c86ac546d137'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:06.489376 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac475e-8e77-406e-8bb2-834b7a62f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:06.532705 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 (508ab26c-20f7-461d-b7a2-7af2110fd1b2): created successfully
Jan 25 13:38:06.535588 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ac475e-8e77-406e-8bb2-834b7a62f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:06.541935 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (cd1cb43e-4e7b-43a4-b1d5-5a9831333d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:38:06.635994 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-2aedb479-ce75-4fd0-93d7-2aebe77cc7c3 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:38:06.771321 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:38:06.877125 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:06.982625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:07.043761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.167s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:07.044425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b\n            Backing store flags: \n    Account information:\n        HBfh8Ypc4CNCLcEdqvfR\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:07.045589 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:38:07.046971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:07.365201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-b0a84695-2a50-47dd-a178-af956c05ae7b -f" returned: 0 in 0.317s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:07.390876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:07.390876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:07.468817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.099s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:07.469505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:07.470303 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8d21dbb6-be03-4568-bbbd-0958be4240df tempest-VolumesBackupsTest-1355027314 None] Remove volume export completed successfully.
Jan 25 13:38:08.002664 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:08.894959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:38:08.906310 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:38:08.908706 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:38:08.973350 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (89981760-2508-4f67-b551-28bc05efb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:38:08.981579 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73707cc1-4956-40fb-90b6-5ec1b981b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:09.059487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:09.064873 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:38:09.168893 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:09.200068 n-d-760454-3 sudo[5512]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:09.201192 n-d-760454-3 sudo[5512]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73707cc1-4956-40fb-90b6-5ec1b981b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:38:08Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_83ae9fc8-2c34-4ab2-a1d0-cde32ceaec0d',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=e10e0fa3-149c-4038-851d-0d6112fccbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330f089a4942a7a8f1eba58db88685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:38:09Z,user_id='253e9e6711fa4978b18bbf3697b15cbf',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e8b36-f464-4f06-adfd-c020181f914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e8b36-f464-4f06-adfd-c020181f914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6c0ff3-9bcf-47e5-8d21-9bbeb08ddb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6c0ff3-9bcf-47e5-8d21-9bbeb08ddb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10e0fa3-149c-4038-851d-0d6112fccbff', 'volume_name': 'volume-e10e0fa3-149c-4038-851d-0d6112fccbff', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1bca00-3585-47b3-9a0a-077953a9d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1bca00-3585-47b3-9a0a-077953a9d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ea0e5-f6ba-4c75-a885-a83c8cd83cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Volume e10e0fa3-149c-4038-851d-0d6112fccbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10e0fa3-149c-4038-851d-0d6112fccbff', 'volume_size': 1}
Jan 25 13:38:09.241571 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e10e0fa3-149c-4038-851d-0d6112fccbff stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:09.265896 n-d-760454-3 sudo[5517]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e10e0fa3-149c-4038-851d-0d6112fccbff stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:38:09.266463 n-d-760454-3 sudo[5517]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:10.075063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:10.281718 n-d-760454-3 sudo[5517]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:10.285094 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e10e0fa3-149c-4038-851d-0d6112fccbff stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.050s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:10.297436 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ea0e5-f6ba-4c75-a885-a83c8cd83cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10e0fa3-149c-4038-851d-0d6112fccbff', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:10.301019 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761e06c1-dcb4-4018-9c50-c4305709b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:10.310390 n-d-760454-3 sudo[5512]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:10.312512 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2" returned: 0 in 1.144s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:10.393293 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Volume volume-e10e0fa3-149c-4038-851d-0d6112fccbff (e10e0fa3-149c-4038-851d-0d6112fccbff): created successfully
Jan 25 13:38:10.404814 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761e06c1-dcb4-4018-9c50-c4305709b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:10.411303 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (89981760-2508-4f67-b551-28bc05efb3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:38:10.414097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:10.414675 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.008s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:10.415163 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 35
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         DhKBCs3PktGFGEK35zeE
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:10.416911 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:38:10.423343 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2,
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2>
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:     incominguser WYenfQPRQt2bUo3BQWrD Z92Uk2mKFQ374q5p
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:38:10.523631 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:38:10.528435 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:10.571173 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Created volume successfully.
Jan 25 13:38:11.083774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:11.257769 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2" returned: 0 in 0.727s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:11.257769 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:11.257769 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:38:11.257769 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:38:11.261697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:11.287124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.027s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:11.287686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 35
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         DhKBCs3PktGFGEK35zeE
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:11.288906 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:38:11.293484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:11.526786 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.235s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:11.527593 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:11.535517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:11.540516 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:11.597770 n-d-760454-3 sudo[5633]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:38:11.598699 n-d-760454-3 sudo[5633]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:11.683416 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.152s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:11.684150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355776]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:11.686266 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:38:12.210222 n-d-760454-3 sudo[5633]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:12.228478 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff" returned: 0 in 0.689s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:12.284693 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:12.285459 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:12.293969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:12.294276 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Targets prior to update: Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 35
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         DhKBCs3PktGFGEK35zeE
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         WYenfQPRQt2bUo3BQWrD
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:12.295221 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:38:12.310161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-e10e0fa3-149c-4038-851d-0d6112fccbff,
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff>
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:     incominguser f4WM6UpmSgYoCAzoj26z 25vUAU7gHNbkoPVV
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:38:12.478031 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:38:12.495526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:12.620291 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-a0b6f6c8-5200-4500-861d-382830200ac7 req-8810e056-9ef6-4011-b908-142df79d520d tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:38:13.012778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff" returned: 0 in 0.532s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:13.013666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:13.014702 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:38:13.015539 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:38:13.017988 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:13.029265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.011s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:13.029917 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Targets after update: Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 35
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         DhKBCs3PktGFGEK35zeE
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]: Target 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030000
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf30
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00030001
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf31
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         WYenfQPRQt2bUo3BQWrD
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:38:13.031050 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:38:13.042105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:13.170848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.137s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:13.171455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:13.178080 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:13.265105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.091s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:13.267291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:13.269866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,4 iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:38:13.295912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:13.377993 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Initialize volume connection completed successfully.
Jan 25 13:38:14.302858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:15.382075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:16.327362 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:17.326552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:18.335035 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:19.342546 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:20.356172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:21.369891 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:22.371023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:23.396757 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:24.415230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:25.413624 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:26.446010 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:27.432165 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:28.438690 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:29.444975 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:30.452728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:31.459896 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:32.473501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:33.492227 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:34.526264 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:34.716012 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-debc5506-1657-451c-a4ec-cc74a8589399 req-139032af-7b00-44d6-bf95-e426d36ea528 tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:38:34.716464 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-debc5506-1657-451c-a4ec-cc74a8589399 req-139032af-7b00-44d6-bf95-e426d36ea528 tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 5e1b1823-770d-482f-9522-e05495088ddf. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:38:34.718694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:34.810773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.091s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:34.811153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2\n            Backing store flags: \n    Account information:\n        WYenfQPRQt2bUo3BQWrD\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:34.813483 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-debc5506-1657-451c-a4ec-cc74a8589399 req-139032af-7b00-44d6-bf95-e426d36ea528 tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: 508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:34.818727 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:34.994802 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 -f" returned: 0 in 0.177s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:34.995125 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:34.998215 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:35.136182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.135s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:35.136182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:35.538060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:35.596221 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-debc5506-1657-451c-a4ec-cc74a8589399 req-139032af-7b00-44d6-bf95-e426d36ea528 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:38:35.596221 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:38:35.596221 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:38:36.156113 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-508ab26c-20f7-461d-b7a2-7af2110fd1b2-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:38:36.419150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:36.556677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:36.607279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.197s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:36.607279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 35\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:36.607279 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: 508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:36.607279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:36.652778 n-d-760454-3 sudo[5782]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:36.655115 n-d-760454-3 sudo[5782]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:38.384174 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:38.567015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:39.112430 n-d-760454-3 sudo[5782]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:39.115384 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2" returned: 0 in 2.514s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:39.117491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:39.155684 n-d-760454-3 sudo[5839]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:39.156225 n-d-760454-3 sudo[5839]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:39.572603 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:39.734833 n-d-760454-3 sudo[5839]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:39.737010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2" returned: 0 in 0.620s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:39.739980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:39.780195 n-d-760454-3 sudo[5854]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:39.781392 n-d-760454-3 sudo[5854]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:40.581130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:41.173381 n-d-760454-3 sudo[5854]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:41.176990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-508ab26c-20f7-461d-b7a2-7af2110fd1b2" returned: 0 in 1.436s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:41.176990 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: 508ab26c-20f7-461d-b7a2-7af2110fd1b2
Jan 25 13:38:41.295855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['b53ca702-f5ca-4574-9642-c9e1921d162c', 'e2d10061-a29e-4f25-b033-7d7b999d6499', '129ba3d2-38e1-4fa7-871e-d84f80278129', '0647fd20-84ee-4f9e-82ca-028ffd8f869d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:38:41.298343 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:38:41.298343 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:38:41.298343 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:38:41.587328 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:41.599794 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:38:41.602258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:41.643791 n-d-760454-3 sudo[5901]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:38:41.644423 n-d-760454-3 sudo[5901]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:42.206192 n-d-760454-3 sudo[5901]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:42.209264 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:42.211526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:42.235583 n-d-760454-3 sudo[5905]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:38:42.236101 n-d-760454-3 sudo[5905]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:42.597028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:42.717318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-51d5182f-27c1-43fc-a61f-c86ac546d137-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:38:42.717318 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:42.755791 n-d-760454-3 sudo[5908]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137
Jan 25 13:38:42.756314 n-d-760454-3 sudo[5908]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:43.317971 n-d-760454-3 sudo[5905]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:43.322282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.108s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:43.329420 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:38:43.351232 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:38:43.525121 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-debc5506-1657-451c-a4ec-cc74a8589399 req-8c2afcbb-89f5-42b8-93d4-f76d073c9509 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-508ab26c-20f7-461d-b7a2-7af2110fd1b2-delete_volume'" released by "delete_volume" :: held 7.369s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:38:43.604319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:44.214201 n-d-760454-3 sudo[5908]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:44.220420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137" returned: 0 in 1.510s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:44.227159 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:44.253155 n-d-760454-3 sudo[5921]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137
Jan 25 13:38:44.253982 n-d-760454-3 sudo[5921]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:44.644515 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:45.644674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:46.655070 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:47.191864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:38:47.191864 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:38:47.191864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:47.216765 n-d-760454-3 sudo[6012]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:38:47.217324 n-d-760454-3 sudo[6012]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:47.491750 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103" returned: 0 in 65.157s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:47.498449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:47.666309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:47.817765 n-d-760454-3 sudo[5921]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:47.823497 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-51d5182f-27c1-43fc-a61f-c86ac546d137" returned: 0 in 3.599s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:47.973635 n-d-760454-3 sudo[6026]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1
Jan 25 13:38:47.974223 n-d-760454-3 sudo[6026]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:48.159179 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['0207429b-1a63-44f7-b4b7-4e2426e07a24', 'f2a8cdfd-6fe6-499f-a29b-c834977f5bbe', 'f25c92ab-5d69-460f-a17e-3a88fdeda1e7', 'b56aa616-baf2-4ebf-93af-1fad7abf96b4'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:38:48.159179 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:38:48.159179 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:38:48.159179 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:38:48.455794 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Delete snapshot completed successfully.
Jan 25 13:38:48.464515 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a250e97c-888d-45ad-b78e-9612a4f2e834 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-51d5182f-27c1-43fc-a61f-c86ac546d137-delete_snapshot'" released by "delete_snapshot" :: held 5.759s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:38:48.480448 n-d-760454-3 sudo[6012]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:48.483784 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.317s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:48.486115 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:48.575349 n-d-760454-3 sudo[6071]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:38:48.575887 n-d-760454-3 sudo[6071]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:48.693463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:48.942323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1" returned: 0 in 1.439s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:48.942323 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpzkt8frzfn-d-760454-3@lvmdriver-1, size 700.00 MB, duration 65.16 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--2a2285cf--8555--46b8--b02c--bd5c7f728103 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:38:48.942323 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Converted 700.00 MB image at 10.74 MB/s
Jan 25 13:38:48.942323 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 2a2285cf-8555-46b8-b02c-bd5c7f728103 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:38:48.929549 n-d-760454-3 sudo[6026]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:49.238241 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user afaac1630ea84f168b663fa86bab3b4d is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:38:49.246113 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Marking volume 2a2285cf-8555-46b8-b02c-bd5c7f728103 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:38:49.332782 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 2a2285cf-8555-46b8-b02c-bd5c7f728103. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:38:49.332782 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Creating volume glance metadata for volume 2a2285cf-8555-46b8-b02c-bd5c7f728103 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:38:49.691939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:49.858507 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f60dbe-e3da-43bf-872f-f0396c765993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2285cf-8555-46b8-b02c-bd5c7f728103', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c401470>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:49.873297 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b764bfd-fbaa-47dc-868c-c401cd077f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:38:49.982439 n-d-760454-3 sudo[6071]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:49.988330 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.499s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:49.988330 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:38:50.031513 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Volume volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 (2a2285cf-8555-46b8-b02c-bd5c7f728103): created successfully
Jan 25 13:38:50.043076 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b764bfd-fbaa-47dc-868c-c401cd077f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:38:50.063143 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Flow 'volume_create_manager' (3258dd0b-67a7-4ac5-a804-c4c54ef15fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:38:50.127285 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1bbf39cd-39cd-4385-87c2-279301630f0e tempest-VolumesImageMetadata-214728320 None] Created volume successfully.
Jan 25 13:38:50.719023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:51.725795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:52.445415 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Lock "b'cinder-2a2285cf-8555-46b8-b02c-bd5c7f728103-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:38:52.872287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:52.880972 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Skipping remove_export. No iscsi_target is presently exported for volume: 2a2285cf-8555-46b8-b02c-bd5c7f728103
Jan 25 13:38:52.880972 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:53.015709 n-d-760454-3 sudo[6159]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103
Jan 25 13:38:53.016841 n-d-760454-3 sudo[6159]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:53.907756 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:54.279596 n-d-760454-3 sudo[6159]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:54.294220 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103" returned: 0 in 1.411s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:54.311255 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:54.369276 n-d-760454-3 sudo[6164]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103
Jan 25 13:38:54.381379 n-d-760454-3 sudo[6164]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:54.939932 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:55.361007 n-d-760454-3 sudo[6164]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:55.368654 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103" returned: 0 in 1.066s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:55.375367 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:55.419319 n-d-760454-3 sudo[6178]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103
Jan 25 13:38:55.420107 n-d-760454-3 sudo[6178]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:56.030455 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:57.036144 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:57.144240 n-d-760454-3 sudo[6178]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:57.151269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-2a2285cf-8555-46b8-b02c-bd5c7f728103" returned: 0 in 1.778s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:57.151269 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Successfully deleted volume: 2a2285cf-8555-46b8-b02c-bd5c7f728103
Jan 25 13:38:57.328583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Created reservations ['bbe52104-f1f5-4afe-a70b-e66cd6afe6c8', '22ef141a-88e5-4654-ac89-fc1ada741f94', 'f2938ffc-ff5f-46b1-b378-9ff07ca8b485', '57ff1b6a-23b0-4aef-b863-08956bb4ad1e'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:38:57.328583 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:38:57.328583 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:38:57.328583 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:38:57.530912 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:38:57.530912 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:57.590059 n-d-760454-3 sudo[6200]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:38:57.590867 n-d-760454-3 sudo[6200]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:58.080352 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:59.045377 n-d-760454-3 sudo[6200]: pam_unix(sudo:session): session closed for user root
Jan 25 13:38:59.052579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.521s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:59.052579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:59.072021 n-d-760454-3 sudo[6235]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:38:59.072618 n-d-760454-3 sudo[6235]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:38:59.098136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:38:59.371087 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-af7063af-52ee-4dd1-a905-468d22ca1e50 tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:38:59.371087 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-af7063af-52ee-4dd1-a905-468d22ca1e50 tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment ab61f548-497a-454b-88bf-35b7c28ee632. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:38:59.386936 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:38:59.676196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.288s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:38:59.676196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9\n            Backing store flags: \n    Account information:\n        DhKBCs3PktGFGEK35zeE\n    ACL information:\n        ALL\nTarget 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:38:59.676196 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-af7063af-52ee-4dd1-a905-468d22ca1e50 tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:38:59.676196 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:00.146860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:00.166985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 -f" returned: 0 in 0.496s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:00.166985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:00.166985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:00.389421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.227s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:00.389987 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:00.705328 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-af7063af-52ee-4dd1-a905-468d22ca1e50 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:39:00.705328 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:39:00.705328 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:39:00.781847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.726s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:00.781847 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:39:00.771564 n-d-760454-3 sudo[6235]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:00.820722 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Deleted volume successfully.
Jan 25 13:39:01.156282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:01.492629 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4aa02fd7-32d9-495f-8e6a-1bb06bb15565 tempest-VolumesImageMetadata-214728320 None] Lock "b'cinder-2a2285cf-8555-46b8-b02c-bd5c7f728103-delete_volume'" released by "delete_volume" :: held 9.045s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:39:01.924080 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:39:02.145853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:02.190426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:02.358383 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.223s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:02.360048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 36\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:02.361244 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:39:02.364420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:02.432745 n-d-760454-3 sudo[6307]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:39:02.433301 n-d-760454-3 sudo[6307]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:03.222818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:03.857611 n-d-760454-3 sudo[6307]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:03.861330 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 1.497s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:03.863376 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:04.027281 n-d-760454-3 sudo[6331]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:39:04.028006 n-d-760454-3 sudo[6331]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:04.238856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:05.046356 n-d-760454-3 sudo[6331]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:05.057047 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 1.194s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:05.094402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:05.156085 n-d-760454-3 sudo[6339]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:39:05.170142 n-d-760454-3 sudo[6339]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:05.266270 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:06.286952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:06.896824 n-d-760454-3 sudo[6339]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:06.927012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9" returned: 0 in 1.809s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:06.927012 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: ebbe4668-c1c7-4794-873e-4b6d6de7b9f9
Jan 25 13:39:07.148519 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['cc5def54-b97a-4926-bf03-b894e5ddf3fe', '4ac6a99e-5238-4578-95d3-a704c360c963', '167bd090-9905-4e17-b150-eadcb9647684', 'e4658310-ae00-41d5-91f0-bf0081319869'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:39:07.148519 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:39:07.148519 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:39:07.148519 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:39:07.353077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:07.353077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:39:07.353077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:07.422432 n-d-760454-3 sudo[6375]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:39:07.431319 n-d-760454-3 sudo[6375]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:08.366131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:08.876049 n-d-760454-3 sudo[6375]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:08.883958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.530s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:08.883958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:09.019470 n-d-760454-3 sudo[6401]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:39:09.020031 n-d-760454-3 sudo[6401]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:09.119466 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:39:09.155294 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:39:09.155294 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:39:09.217470 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Flow 'volume_create_manager' (10bf689d-be92-4d23-8f8f-2f16a4405f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:09.234361 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29271bc-c3b8-4296-ad6b-c6072cf40f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:09.322869 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:39:09.544354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29271bc-c3b8-4296-ad6b-c6072cf40f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1564020123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c179cec9-3a76-4ae9-afa7-46f179ccc4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46cbb451bd74e399abbacbf45fae1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:39:09Z,user_id='bfb6b671023543208db8e78f20206134',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:09.573260 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1a3ecd-817f-4a83-9943-0a5b9c60a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:09.573260 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1a3ecd-817f-4a83-9943-0a5b9c60a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:09.599031 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69503fd1-1a7c-45df-b412-722e69984a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:09.599031 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69503fd1-1a7c-45df-b412-722e69984a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c179cec9-3a76-4ae9-afa7-46f179ccc4aa', 'volume_name': 'volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:09.625286 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb593930-5119-413d-be95-59db605e2f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:09.641945 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb593930-5119-413d-be95-59db605e2f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:09.641945 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07872f93-0f1e-4e72-911d-f1a6a33282cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:09.641945 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Volume c179cec9-3a76-4ae9-afa7-46f179ccc4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa', 'volume_size': 1}
Jan 25 13:39:09.678422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:09.777436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:09.800323 n-d-760454-3 sudo[6403]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:39:09.801211 n-d-760454-3 sudo[6403]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:10.389238 n-d-760454-3 sudo[6401]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:10.392853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.511s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:10.395718 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:39:10.411429 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:39:10.506066 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-ad2f3197-3867-4451-be2a-f8ea1b70cdc9 req-30ecb285-ef4d-4d24-aaef-f7e323789611 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-ebbe4668-c1c7-4794-873e-4b6d6de7b9f9-delete_volume'" released by "delete_volume" :: held 8.586s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:39:10.778352 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:10.841690 n-d-760454-3 sudo[6403]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:10.844567 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.171s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:10.852449 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07872f93-0f1e-4e72-911d-f1a6a33282cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:10.859645 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5756883-1b18-402c-9a7e-710d32a594f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:10.918565 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Volume volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa (c179cec9-3a76-4ae9-afa7-46f179ccc4aa): created successfully
Jan 25 13:39:10.933036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5756883-1b18-402c-9a7e-710d32a594f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:10.948202 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Flow 'volume_create_manager' (10bf689d-be92-4d23-8f8f-2f16a4405f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:11.000680 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-02d93757-9098-4840-98b7-fac32864c650 tempest-SnapshotMetadataTestJSON-508109782 None] Created volume successfully.
Jan 25 13:39:11.787149 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:12.544447 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:39:12.595620 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e3d51af8-7d25-4000-b6d4-d57305c63201 tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:12.627852 n-d-760454-3 sudo[6468]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:12.631514 n-d-760454-3 sudo[6468]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:12.696634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:12.800187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:12.901339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.205s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:12.901923 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356688]: (4, ('Target 4: iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00040000\n            SCSI SN: beaf40\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00040001\n            SCSI SN: beaf41\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff\n            Backing store flags: \n    Account information:\n        f4WM6UpmSgYoCAzoj26z\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:12.903095 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:12.908135 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:13.343621 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-e10e0fa3-149c-4038-851d-0d6112fccbff -f" returned: 0 in 0.439s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:13.344277 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356688]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:13.347534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:13.467622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.121s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:13.468229 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356688]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:13.469473 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9cab3b64-90e2-4f4e-8969-d31e9785c0d7 tempest-VolumesBackupsTest-1355027314 None] Remove volume export completed successfully.
Jan 25 13:39:13.581788 n-d-760454-3 sudo[6468]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:13.584288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e3d51af8-7d25-4000-b6d4-d57305c63201 tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa" returned: 0 in 0.989s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:13.586195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e3d51af8-7d25-4000-b6d4-d57305c63201 tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641 --snapshot stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:13.639442 n-d-760454-3 sudo[6492]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641 --snapshot stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa -L 1.00g
Jan 25 13:39:13.640253 n-d-760454-3 sudo[6492]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:13.809648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:14.503922 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-e10e0fa3-149c-4038-851d-0d6112fccbff-delete_volume'" acquired by "delete_volume" :: waited 0.043s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:39:14.785769 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:14.817230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:14.891793 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.110s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:14.892213 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356688]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:14.893521 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Skipping remove_export. No iscsi_target is presently exported for volume: e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:14.894438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:14.953062 n-d-760454-3 sudo[6596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:14.954388 n-d-760454-3 sudo[6596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:14.998465 n-d-760454-3 sudo[6492]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:15.001889 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-e3d51af8-7d25-4000-b6d4-d57305c63201 tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641 --snapshot stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa -L 1.00g" returned: 0 in 1.415s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:15.164910 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-e3d51af8-7d25-4000-b6d4-d57305c63201 tempest-SnapshotMetadataTestJSON-508109782 None] Create snapshot completed successfully
Jan 25 13:39:15.587987 n-d-760454-3 sudo[6596]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:15.590702 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff" returned: 0 in 0.696s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:15.592342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:15.618064 n-d-760454-3 sudo[6609]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:15.618783 n-d-760454-3 sudo[6609]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:15.829179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:16.279631 n-d-760454-3 sudo[6609]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:16.282096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff" returned: 0 in 0.690s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:16.285133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:16.386565 n-d-760454-3 sudo[6615]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:16.397595 n-d-760454-3 sudo[6615]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:16.875142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:17.592220 n-d-760454-3 sudo[6615]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:17.595398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e10e0fa3-149c-4038-851d-0d6112fccbff" returned: 0 in 1.310s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:17.597391 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: e10e0fa3-149c-4038-851d-0d6112fccbff
Jan 25 13:39:17.633147 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:39:17.646287 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:39:17.647127 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:39:17.670583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (b838ac1e-62c8-4473-966d-ff612bb130d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:17.678434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d097976-e219-4d1b-b0b2-da302a408168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:17.739537 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:39:17.807010 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d097976-e219-4d1b-b0b2-da302a408168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-387276567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=94092ae1-bc5e-4971-a4e2-73ad375b7576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:39:17Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:17.812495 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55664208-e8ad-45ca-b730-5af88db49a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:17.817975 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55664208-e8ad-45ca-b730-5af88db49a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:17.823101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddf6794-09af-4fbb-b11e-758550002ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:18.009412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:18.040069 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Created reservations ['c09007b7-416e-4e5b-bedb-a5d8e6212429', 'a404741a-5fdf-4957-9814-53b403b92be1', '50e78890-5b29-440a-b77d-bf707e6171a6', '9fd436a1-2ae5-418f-81ac-c914680418bb'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:39:18.045233 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:39:18.045233 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:39:18.045233 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:39:18.220212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddf6794-09af-4fbb-b11e-758550002ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94092ae1-bc5e-4971-a4e2-73ad375b7576', 'volume_name': 'volume-94092ae1-bc5e-4971-a4e2-73ad375b7576', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f673d68>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:18.223424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f06019f-3084-43c2-98a7-acb2e5a0c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:18.226261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f06019f-3084-43c2-98a7-acb2e5a0c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:18.229904 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1228aa86-649b-494b-bbeb-aa02fb6a8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:18.231085 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Volume 94092ae1-bc5e-4971-a4e2-73ad375b7576: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94092ae1-bc5e-4971-a4e2-73ad375b7576', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f673d68>}
Jan 25 13:39:18.232099 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Cloning 94092ae1-bc5e-4971-a4e2-73ad375b7576 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:39:18.315428 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:39:18.317876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:18.385527 n-d-760454-3 sudo[6668]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:39:18.386406 n-d-760454-3 sudo[6668]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:19.031382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:19.508755 n-d-760454-3 sudo[6668]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:19.511467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.193s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:19.513545 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:19.546434 n-d-760454-3 sudo[6700]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:39:19.550041 n-d-760454-3 sudo[6700]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:20.130427 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:20.471594 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Lock "b'cinder-c59c4ae7-6291-4dac-91ed-a8d512c98641-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:39:20.475492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:20.528818 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:39:20.544446 n-d-760454-3 sudo[6721]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641
Jan 25 13:39:20.549854 n-d-760454-3 sudo[6721]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:20.550282 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:39:20.551109 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:39:20.601646 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (51e754d8-ce65-4d62-8536-87505ae7b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:20.606835 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3df381e-e74d-4ecb-9604-9ad68233b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:20.654491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:39:20.688148 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3df381e-e74d-4ecb-9604-9ad68233b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-826102728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=5eb4b2d2-8919-49a0-a153-90b75d019238,launched_at=None,metadata={vol-meta1='value1',vol-meta2='value2',vol-meta3='value3'},migration_status=None,multiattach=False,previous_status=None,project_id='83330f089a4942a7a8f1eba58db88685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:39:20Z,user_id='253e9e6711fa4978b18bbf3697b15cbf',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:20.694525 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3c81a3-9ade-4cab-a4f1-e6ef83e6aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:20.697657 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3c81a3-9ade-4cab-a4f1-e6ef83e6aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:20.700640 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd91ce51-6d46-4752-9061-2879ed43e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:20.703691 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd91ce51-6d46-4752-9061-2879ed43e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb4b2d2-8919-49a0-a153-90b75d019238', 'volume_name': 'volume-5eb4b2d2-8919-49a0-a153-90b75d019238', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:20.707298 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba92acd-4f97-4b50-aecb-c0952ed91c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:20.710485 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba92acd-4f97-4b50-aecb-c0952ed91c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:20.713459 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401b0e89-1a5d-43bf-8ff6-d0d053cb0683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:20.714469 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Volume 5eb4b2d2-8919-49a0-a153-90b75d019238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb4b2d2-8919-49a0-a153-90b75d019238', 'volume_size': 1}
Jan 25 13:39:20.715842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5eb4b2d2-8919-49a0-a153-90b75d019238 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:20.768290 n-d-760454-3 sudo[6726]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5eb4b2d2-8919-49a0-a153-90b75d019238 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:39:20.773289 n-d-760454-3 sudo[6726]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:20.848263 n-d-760454-3 sudo[6700]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:20.853954 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.337s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:20.853954 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:39:20.884936 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:39:20.970352 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-f461c935-1996-4381-9c1f-f766041afb07 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-e10e0fa3-149c-4038-851d-0d6112fccbff-delete_volume'" released by "delete_volume" :: held 6.468s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:39:21.174755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:21.905457 n-d-760454-3 sudo[6726]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:21.909349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5eb4b2d2-8919-49a0-a153-90b75d019238 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.193s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:21.922161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401b0e89-1a5d-43bf-8ff6-d0d053cb0683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb4b2d2-8919-49a0-a153-90b75d019238', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:21.925089 n-d-760454-3 sudo[6721]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:21.938760 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b8e703-6022-4cc8-8bc0-94bd105ea262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:21.953632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641" returned: 0 in 1.476s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:21.962644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:22.000868 n-d-760454-3 sudo[6761]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641
Jan 25 13:39:22.006078 n-d-760454-3 sudo[6761]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:22.079721 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Volume volume-5eb4b2d2-8919-49a0-a153-90b75d019238 (5eb4b2d2-8919-49a0-a153-90b75d019238): created successfully
Jan 25 13:39:22.083539 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b8e703-6022-4cc8-8bc0-94bd105ea262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:22.090895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (51e754d8-ce65-4d62-8536-87505ae7b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:22.193259 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9d21c955-ab5b-42ad-afde-9d1f4e830389 tempest-VolumesBackupsTest-1355027314 None] Created volume successfully.
Jan 25 13:39:22.208589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:23.245001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:23.639706 n-d-760454-3 sudo[6761]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:23.642013 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c59c4ae7-6291-4dac-91ed-a8d512c98641" returned: 0 in 1.679s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:23.898481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Created reservations ['a1fde94a-c52a-4f4c-8f31-b90227080aae', '837d3c42-5314-4510-817e-9b699954059c', '627dba69-f240-490a-aab7-62a83ca682d9', 'e904cab7-a019-43d3-ad8b-c738e846546b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:39:23.906344 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:39:23.906344 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:39:23.906344 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:39:24.136134 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Delete snapshot completed successfully.
Jan 25 13:39:24.152431 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c67d1406-6f9c-4bee-a491-f6e2eeb8a679 tempest-SnapshotMetadataTestJSON-508109782 None] Lock "b'cinder-c59c4ae7-6291-4dac-91ed-a8d512c98641-delete_snapshot'" released by "delete_snapshot" :: held 3.681s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:39:24.281761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:24.490504 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Creating a new backup for volume volume-5eb4b2d2-8919-49a0-a153-90b75d019238. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:39:24.508518 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:24.549409 n-d-760454-3 sudo[6863]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:39:24.561303 n-d-760454-3 sudo[6863]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:25.301767 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:25.305948 n-d-760454-3 sudo[6863]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:25.311555 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238" returned: 0 in 0.803s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:25.389281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:25.401955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.020s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:25.402494 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:25.405642 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:39:25.409091 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-5eb4b2d2-8919-49a0-a153-90b75d019238,
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238>
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:     incominguser 3fhdrjaEhhPFBakxtL5U Lz4B9D6ZGTMwVJUA
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:39:25.511004 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:39:25.514496 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Lock "b'cinder-c179cec9-3a76-4ae9-afa7-46f179ccc4aa-delete_volume'" acquired by "delete_volume" :: waited 0.133s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:39:25.531395 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:25.690176 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Skipping remove_export. No iscsi_target is presently exported for volume: c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:25.690176 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:25.757177 n-d-760454-3 sudo[6896]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:25.757714 n-d-760454-3 sudo[6896]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:26.142911 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238" returned: 0 in 0.628s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:26.146917 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:26.146917 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:39:26.146917 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:39:26.147660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:26.174257 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.023s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:26.174862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:26.179314 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:39:26.181998 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:26.309097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:26.329248 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.147s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:26.329983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:26.333127 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:26.452647 n-d-760454-3 sudo[6896]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:26.457477 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa" returned: 0 in 0.771s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:26.471693 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:26.497894 n-d-760454-3 sudo[6949]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:26.498491 n-d-760454-3 sudo[6949]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:26.569609 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.235s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:26.569609 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:39:26.570182 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:39:26.692209 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Initialize volume connection completed successfully.
Jan 25 13:39:27.239897 n-d-760454-3 sudo[6949]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:27.246421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa" returned: 0 in 0.778s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:27.246421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:27.278225 n-d-760454-3 sudo[7009]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:27.280471 n-d-760454-3 sudo[7009]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:27.321576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:28.334411 n-d-760454-3 sudo[7009]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:28.351032 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c179cec9-3a76-4ae9-afa7-46f179ccc4aa" returned: 0 in 1.092s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:28.351032 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Successfully deleted volume: c179cec9-3a76-4ae9-afa7-46f179ccc4aa
Jan 25 13:39:28.361674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:28.495168 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Created reservations ['65f31879-724f-46fe-8be3-6224202c7064', '7ace3989-abee-4221-bda8-8a9c0b30a632', '14478a80-43f5-4b1b-946d-541248c1dd83', '18c2e0b4-fa0f-48ff-b71e-43f5648499c3'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:39:28.498655 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:39:28.498655 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:39:28.498655 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:39:28.706489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:39:28.709117 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:28.770163 n-d-760454-3 sudo[7025]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:39:28.770932 n-d-760454-3 sudo[7025]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:29.381847 n-d-760454-3 sudo[7025]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:29.386469 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:29.388805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:29.391506 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:29.437675 n-d-760454-3 sudo[7029]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:39:29.438252 n-d-760454-3 sudo[7029]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:30.398185 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:30.443281 n-d-760454-3 sudo[7029]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:30.446656 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.055s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:30.449733 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:39:30.475222 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Deleted volume successfully.
Jan 25 13:39:30.538577 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-fa4cfb91-841e-4a93-8394-2e53b48c4c6f tempest-SnapshotMetadataTestJSON-508109782 None] Lock "b'cinder-c179cec9-3a76-4ae9-afa7-46f179ccc4aa-delete_volume'" released by "delete_volume" :: held 5.024s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:39:31.406154 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:32.415615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:33.423913 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:34.433204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:35.440929 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:36.451122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:37.458113 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:38.469020 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:39.291139 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:39:39.295889 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:39:39.296449 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:39:39.311622 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Flow 'volume_create_manager' (98b015c4-0194-485a-9bb8-b7abca6af8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:39.316092 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac807da-dd6e-4679-8264-da809b07e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:39.342755 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:39:39.377915 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac807da-dd6e-4679-8264-da809b07e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1862223731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=663482a4-82aa-45d8-a060-e9d666b85b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b2ea4e658544e686a8a6fad2ca89c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:39:39Z,user_id='ae73337dcdd4449ba2a543a202c0e2a3',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:39.381219 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ec581-5026-446f-b448-4fa4ffda4052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:39.383706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ec581-5026-446f-b448-4fa4ffda4052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:39.386498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff990769-f8c0-4fcc-975e-0ad4f72f98a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:39.389072 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff990769-f8c0-4fcc-975e-0ad4f72f98a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663482a4-82aa-45d8-a060-e9d666b85b75', 'volume_name': 'volume-663482a4-82aa-45d8-a060-e9d666b85b75', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:39.392259 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818719a4-74fe-4362-92c7-ecd98bdb8db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:39.394699 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818719a4-74fe-4362-92c7-ecd98bdb8db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:39.397203 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a43cd-e4f0-4010-9410-ab7c6a914904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:39.398176 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Volume 663482a4-82aa-45d8-a060-e9d666b85b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663482a4-82aa-45d8-a060-e9d666b85b75', 'volume_size': 1}
Jan 25 13:39:39.399425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-663482a4-82aa-45d8-a060-e9d666b85b75 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:39.418580 n-d-760454-3 sudo[7079]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-663482a4-82aa-45d8-a060-e9d666b85b75 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:39:39.419127 n-d-760454-3 sudo[7079]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:39.478671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:40.057064 n-d-760454-3 sudo[7079]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:40.059104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-663482a4-82aa-45d8-a060-e9d666b85b75 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.660s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:40.064657 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826a43cd-e4f0-4010-9410-ab7c6a914904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663482a4-82aa-45d8-a060-e9d666b85b75', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:40.067214 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99395b56-6aa5-472a-9023-8951ea61ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:39:40.363675 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Volume volume-663482a4-82aa-45d8-a060-e9d666b85b75 (663482a4-82aa-45d8-a060-e9d666b85b75): created successfully
Jan 25 13:39:40.365863 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99395b56-6aa5-472a-9023-8951ea61ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:39:40.369305 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Flow 'volume_create_manager' (98b015c4-0194-485a-9bb8-b7abca6af8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:39:40.484924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:40.501883 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-836bcced-b48d-4ef5-80db-cd460ad42616 tempest-VolumesNegativeTest-1558814283 None] Created volume successfully.
Jan 25 13:39:41.509543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:43.169481 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1, size 616.00 MB, duration 24.93 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:39:43.170089 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Image download 616.00 MB at 24.71 MB/s
Jan 25 13:39:43.179116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:43.220805 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:43.318622 n-d-760454-3 sudo[7122]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1
Jan 25 13:39:43.319271 n-d-760454-3 sudo[7122]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:43.711793 n-d-760454-3 sudo[7122]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:43.720164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1" returned: 0 in 0.497s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:43.721389 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user e05ff2642a9b43da927aa763694ac642. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:39:43.866123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:44.013514 n-d-760454-3 sudo[7135]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1
Jan 25 13:39:44.014068 n-d-760454-3 sudo[7135]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:44.190991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:44.408449 n-d-760454-3 sudo[7135]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:44.410489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1" returned: 0 in 0.544s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:44.412123 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:44.432778 n-d-760454-3 sudo[7139]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:39:44.433315 n-d-760454-3 sudo[7139]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:45.202237 n-d-760454-3 sudo[7139]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:45.223912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:45.223912 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.800s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:45.322739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 94092ae1-bc5e-4971-a4e2-73ad375b7576. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:39:45.410748 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_4jbik56 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:45.522761 n-d-760454-3 sudo[7171]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_4jbik56
Jan 25 13:39:45.523370 n-d-760454-3 sudo[7171]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:45.969746 n-d-760454-3 sudo[7171]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:45.972037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp_4jbik56" returned: 0 in 0.561s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:45.973956 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:46.080861 n-d-760454-3 sudo[7174]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1
Jan 25 13:39:46.081590 n-d-760454-3 sudo[7174]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:46.240317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:46.551266 n-d-760454-3 sudo[7174]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:46.553199 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1" returned: 0 in 0.579s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:46.554227 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:39:46.555937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:46.580253 n-d-760454-3 sudo[7181]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576 oflag=direct
Jan 25 13:39:46.580877 n-d-760454-3 sudo[7181]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:47.014448 n-d-760454-3 sudo[7181]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:47.017412 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576 oflag=direct" returned: 0 in 0.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:47.018807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:47.037688 n-d-760454-3 sudo[7191]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576
Jan 25 13:39:47.038351 n-d-760454-3 sudo[7191]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:47.166195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:39:47.166678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:39:47.168053 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:47.209424 n-d-760454-3 sudo[7193]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:39:47.210889 n-d-760454-3 sudo[7193]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:47.248737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:47.679779 n-d-760454-3 sudo[7193]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:47.682685 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:47.682685 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:39:47.701431 n-d-760454-3 sudo[7207]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:39:47.701976 n-d-760454-3 sudo[7207]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:39:48.258241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:48.368419 n-d-760454-3 sudo[7207]: pam_unix(sudo:session): session closed for user root
Jan 25 13:39:48.370449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:39:48.373308 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:39:49.273595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:50.283044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:51.278836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:52.285481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:53.292067 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:54.298118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:55.303463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:56.309059 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:57.315416 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:58.323387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:39:59.329056 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:00.338677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:01.345952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:02.364150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:03.357900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:04.363750 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:05.369283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:05.794988 n-d-760454-3 sudo[7191]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:05.797730 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576" returned: 0 in 18.778s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:05.798778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:05.918977 n-d-760454-3 sudo[7317]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1
Jan 25 13:40:05.921492 n-d-760454-3 sudo[7317]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:06.378297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:06.543913 n-d-760454-3 sudo[7317]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:06.548998 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1" returned: 0 in 0.750s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:06.554039 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpunc9w0g2n-d-760454-3@lvmdriver-1, size 700.00 MB, duration 18.78 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--94092ae1--bc5e--4971--a4e2--73ad375b7576 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:40:06.554168 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Converted 700.00 MB image at 37.27 MB/s
Jan 25 13:40:06.554902 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 94092ae1-bc5e-4971-a4e2-73ad375b7576 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:40:06.729938 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user e05ff2642a9b43da927aa763694ac642 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:40:06.731527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Marking volume 94092ae1-bc5e-4971-a4e2-73ad375b7576 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:40:06.774135 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 94092ae1-bc5e-4971-a4e2-73ad375b7576. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:40:06.774841 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Creating volume glance metadata for volume 94092ae1-bc5e-4971-a4e2-73ad375b7576 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:40:07.085386 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1228aa86-649b-494b-bbeb-aa02fb6a8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94092ae1-bc5e-4971-a4e2-73ad375b7576', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8f673d68>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:07.089287 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91733050-e1b0-4a5b-86df-83e40710dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:07.150894 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Volume volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 (94092ae1-bc5e-4971-a4e2-73ad375b7576): created successfully
Jan 25 13:40:07.153041 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91733050-e1b0-4a5b-86df-83e40710dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:07.156982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (b838ac1e-62c8-4473-966d-ff612bb130d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:07.224762 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c4af1732-822b-4ca2-9eae-2755f97e52c5 tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:40:07.387165 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:08.394736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:09.403969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:10.410281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:11.416122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:12.424694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:12.445270 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Lock "b'cinder-663482a4-82aa-45d8-a060-e9d666b85b75-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:12.592775 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Skipping remove_export. No iscsi_target is presently exported for volume: 663482a4-82aa-45d8-a060-e9d666b85b75
Jan 25 13:40:12.594195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:12.611333 n-d-760454-3 sudo[7361]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75
Jan 25 13:40:12.611894 n-d-760454-3 sudo[7361]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:13.423963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:13.440216 n-d-760454-3 sudo[7365]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:13.440890 n-d-760454-3 sudo[7365]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:13.445295 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:13.808492 n-d-760454-3 sudo[7365]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:13.810413 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.387s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:13.861928 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:13.868262 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:13.868633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 38\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 38
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         3fhdrjaEhhPFBakxtL5U
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:40:13.869291 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:40:13.872009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:40:14.071152 n-d-760454-3 sudo[7361]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576,
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576>
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:     incominguser 6QhmEtbJv5sWJe8siis4 FrJCSKPiLj2Qszqp
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:40:14.589498 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:40:14.596969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:14.596969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75" returned: 0 in 2.000s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:14.596969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:14.612207 n-d-760454-3 sudo[7371]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75
Jan 25 13:40:14.612915 n-d-760454-3 sudo[7371]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:14.617719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:15.053862 n-d-760454-3 sudo[7371]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:15.056177 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75" returned: 0 in 0.461s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.058072 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:15.104082 n-d-760454-3 sudo[7382]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75
Jan 25 13:40:15.107299 n-d-760454-3 sudo[7382]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:15.276511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.684s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.277327 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:15.278327 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:40:15.279673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:40:15.284420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:15.321623 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.033s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.322135 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 38\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 38
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Connection: 0
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.65
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         3fhdrjaEhhPFBakxtL5U
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:40:15.325105 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:40:15.344203 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:15.446146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.108s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.446741 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 38\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:15.450346 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:15.595261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.146s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.596216 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356080]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 38\n            Initiator: iqn.1993-08.org.debian:01:943cddd8a8b0 alias: n-d-760454-3\n            Connection: 0\n                IP Address: 10.222.0.65\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:15.597445 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:40:15.636685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:15.819951 n-d-760454-3 sudo[7382]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:15.821726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-663482a4-82aa-45d8-a060-e9d666b85b75" returned: 0 in 0.764s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:15.822585 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Successfully deleted volume: 663482a4-82aa-45d8-a060-e9d666b85b75
Jan 25 13:40:16.128553 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Created reservations ['1392650a-3688-4ac9-89a0-3cc0a46e77d0', 'fd0fa200-7887-4a9f-814b-b9a800754445', '88891495-4358-4304-8eef-ab4c7db0780a', '6726fd5d-cbe7-4c79-8774-c5f43516ef66'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:16.132048 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:16.132048 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:16.132048 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:16.212397 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:16.212397 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:16.212397 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:16.225046 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:16.225046 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:16.225046 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:16.232792 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-e17504cd-d628-488b-9a23-3397529f9f35 req-8f48be4d-2d4f-43b2-8c6d-1c5ce16e4d2f tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:40:16.332806 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:16.333619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:16.363299 n-d-760454-3 sudo[7426]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:16.363938 n-d-760454-3 sudo[7426]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:16.647220 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:16.819097 n-d-760454-3 sudo[7426]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:16.821619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:16.824019 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:16.842084 n-d-760454-3 sudo[7432]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:16.843692 n-d-760454-3 sudo[7432]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:17.667984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:17.719267 n-d-760454-3 sudo[7432]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:17.721162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.898s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:17.723732 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:40:17.730340 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Deleted volume successfully.
Jan 25 13:40:17.778933 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cfa9066b-ece8-4bbf-adad-79f57a12c634 tempest-VolumesNegativeTest-1558814283 None] Lock "b'cinder-663482a4-82aa-45d8-a060-e9d666b85b75-delete_volume'" released by "delete_volume" :: held 5.334s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:40:18.665323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:19.678629 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:20.679808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:21.685772 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:22.044231 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:22.049847 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:22.053038 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:22.073657 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Flow 'volume_create_manager' (832ddd1d-6a2b-4b7a-9caf-08e63a9178ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:22.090845 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e2260-6661-42dd-a089-fa4bb634c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.117819 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:22.154050 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e2260-6661-42dd-a089-fa4bb634c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-999152308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=44d38516-c7b5-4a6f-9a4b-c3af0adb7159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4bbe5cb4cb84866bca9a45544d623e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:22Z,user_id='2697e5a862a4482d84b0ecbe44137125',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.157109 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bbfb4c-7a28-4fd5-9f56-12abcf823cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.159604 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bbfb4c-7a28-4fd5-9f56-12abcf823cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.165037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc12703-8052-4bcf-8eae-c2c36fd51e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.169308 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc12703-8052-4bcf-8eae-c2c36fd51e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d38516-c7b5-4a6f-9a4b-c3af0adb7159', 'volume_name': 'volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159', 'volume_size': 2}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.173135 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac85b7a-d970-44ba-bd79-a2c6fdd61c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.175619 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac85b7a-d970-44ba-bd79-a2c6fdd61c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.177991 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae5a2f-a5ac-4df9-a20b-2b81fd340f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.178972 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Volume 44d38516-c7b5-4a6f-9a4b-c3af0adb7159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159', 'volume_size': 2}
Jan 25 13:40:22.180212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 stack-volumes-lvmdriver-1 -L 2g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:22.197936 n-d-760454-3 sudo[7456]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 stack-volumes-lvmdriver-1 -L 2g
Jan 25 13:40:22.198558 n-d-760454-3 sudo[7456]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:22.694245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:22.799276 n-d-760454-3 sudo[7456]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:22.804145 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 stack-volumes-lvmdriver-1 -L 2g" returned: 0 in 0.621s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:22.804673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ae5a2f-a5ac-4df9-a20b-2b81fd340f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159', 'volume_size': 2}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.807278 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44f46f5-7181-4fbb-b0f1-1492dddfa3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:22.864767 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Volume volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 (44d38516-c7b5-4a6f-9a4b-c3af0adb7159): created successfully
Jan 25 13:40:22.866968 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44f46f5-7181-4fbb-b0f1-1492dddfa3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:22.870442 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Flow 'volume_create_manager' (832ddd1d-6a2b-4b7a-9caf-08e63a9178ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:22.910919 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-75c96ea2-a884-40f7-9f5f-d89d8a09eb0c tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Created volume successfully.
Jan 25 13:40:23.704384 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:23.915591 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9764c196-44f3-4c05-a074-4299baf79301 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:23.933850 n-d-760454-3 sudo[7487]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:23.934490 n-d-760454-3 sudo[7487]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:24.422311 n-d-760454-3 sudo[7487]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:24.424666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9764c196-44f3-4c05-a074-4299baf79301 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159" returned: 0 in 0.509s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:24.425831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9764c196-44f3-4c05-a074-4299baf79301 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b --snapshot stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 -L 2.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:24.444106 n-d-760454-3 sudo[7491]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b --snapshot stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 -L 2.00g
Jan 25 13:40:24.445033 n-d-760454-3 sudo[7491]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:24.713286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:25.368968 n-d-760454-3 sudo[7491]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:25.370845 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9764c196-44f3-4c05-a074-4299baf79301 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b --snapshot stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 -L 2.00g" returned: 0 in 0.945s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:25.464455 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9764c196-44f3-4c05-a074-4299baf79301 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Create snapshot completed successfully
Jan 25 13:40:25.719118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:26.165939 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Lock "b'cinder-124a6c26-4a61-4cd5-a295-73b8e98e0c7b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:26.167963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:26.206572 n-d-760454-3 sudo[7591]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b
Jan 25 13:40:26.207128 n-d-760454-3 sudo[7591]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:26.730916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:26.765383 n-d-760454-3 sudo[7591]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:26.769009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b" returned: 0 in 0.600s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:26.770897 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:26.788016 n-d-760454-3 sudo[7597]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b
Jan 25 13:40:26.788959 n-d-760454-3 sudo[7597]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:27.508608 n-d-760454-3 sudo[7597]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:27.510777 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-124a6c26-4a61-4cd5-a295-73b8e98e0c7b" returned: 0 in 0.739s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:27.653678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Created reservations ['97b9e6d7-22e3-4858-ad20-57a845cb7314', '74468cd3-0e47-4ebc-81ff-a727ca4da30d', 'd216143b-6d69-4e5b-b4f0-b4ae3c519ef6', 'a1829717-71d9-4f62-863e-eff84e393f9c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:27.657481 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:27.657481 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:27.657481 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:27.741835 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:27.807930 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Delete snapshot completed successfully.
Jan 25 13:40:27.816001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-1d77279b-5c47-4d05-8b9c-39cdfe5ca857 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Lock "b'cinder-124a6c26-4a61-4cd5-a295-73b8e98e0c7b-delete_snapshot'" released by "delete_snapshot" :: held 1.650s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:40:28.524598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Lock "b'cinder-44d38516-c7b5-4a6f-9a4b-c3af0adb7159-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:28.653335 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Skipping remove_export. No iscsi_target is presently exported for volume: 44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:28.654320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:28.671534 n-d-760454-3 sudo[7638]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:28.672258 n-d-760454-3 sudo[7638]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:28.755855 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:29.332423 n-d-760454-3 sudo[7638]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:29.335651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159" returned: 0 in 0.681s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:29.337006 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:29.357294 n-d-760454-3 sudo[7644]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:29.357838 n-d-760454-3 sudo[7644]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:29.744870 n-d-760454-3 sudo[7644]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:29.782922 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159" returned: 0 in 0.446s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:29.787659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:29.804942 n-d-760454-3 sudo[7666]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:29.805640 n-d-760454-3 sudo[7666]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:29.820956 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:40:29.895176 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:29.904679 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:30.049989 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.147s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:30.050541 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238\n            Backing store flags: \n    Account information:\n        3fhdrjaEhhPFBakxtL5U\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:30.051524 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: 5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:40:30.054999 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:30.308972 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-5eb4b2d2-8919-49a0-a153-90b75d019238 -f" returned: 0 in 0.255s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:30.309405 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:30.311985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:30.499022 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.188s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:30.499517 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355016]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:30.500585 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6ad9e33c-895e-496d-b004-6ba09a90b47c tempest-VolumesBackupsTest-1355027314 None] Remove volume export completed successfully.
Jan 25 13:40:30.507640 n-d-760454-3 sudo[7666]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:30.509795 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44d38516-c7b5-4a6f-9a4b-c3af0adb7159" returned: 0 in 0.722s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:30.510875 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Successfully deleted volume: 44d38516-c7b5-4a6f-9a4b-c3af0adb7159
Jan 25 13:40:30.601944 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Created reservations ['7c5ea17a-509f-433e-9d75-fb9f41bfa66a', '9e463213-ac12-417a-bf93-83b4c40c8543', '5ffff0ea-2823-496e-aaa0-eda2c977f6ec', '61735ae6-5dee-435e-93fd-136ef0ac0596'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:30.604291 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:30.604291 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:30.604291 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:30.756423 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:30.757417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:30.777537 n-d-760454-3 sudo[7689]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:30.778136 n-d-760454-3 sudo[7689]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:30.911848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:31.167983 n-d-760454-3 sudo[7689]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:31.170098 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:31.172350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:31.190227 n-d-760454-3 sudo[7693]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:31.190916 n-d-760454-3 sudo[7693]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:31.432336 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:31.432336 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:31.433516 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:31.461983 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (512a966e-0c80-481f-8c59-30d39f7d49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:31.465613 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55cdb14-89de-458c-9de4-475f4e25612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:31.497591 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:31.533068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55cdb14-89de-458c-9de4-475f4e25612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:31Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_1eb4e934-2b2d-4823-a23e-886b7e7d4dfc',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=9926cc19-23c7-4dd7-80a4-e30a30bb4c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83330f089a4942a7a8f1eba58db88685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:31Z,user_id='253e9e6711fa4978b18bbf3697b15cbf',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:31.536090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e5640a-e2d4-41ca-8a37-106a4d0e7153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:31.538394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e5640a-e2d4-41ca-8a37-106a4d0e7153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:31.541094 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92193c92-56e0-4779-8675-4930149a2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:31.543639 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92193c92-56e0-4779-8675-4930149a2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9926cc19-23c7-4dd7-80a4-e30a30bb4c37', 'volume_name': 'volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:31.546728 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c6a1f-6f73-4123-a48b-086a020525c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:31.549122 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7c6a1f-6f73-4123-a48b-086a020525c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:31.551405 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3880b-344b-45fb-9081-8dce27d8e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:31.552330 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Volume 9926cc19-23c7-4dd7-80a4-e30a30bb4c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37', 'volume_size': 1}
Jan 25 13:40:31.553489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:31.571074 n-d-760454-3 sudo[7697]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:40:31.571748 n-d-760454-3 sudo[7697]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:31.726082 n-d-760454-3 sudo[7693]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:31.737278 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:31.737278 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:40:31.737278 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Deleted volume successfully.
Jan 25 13:40:31.822632 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-873c0473-988d-4a0f-848e-7561a04cf4a1 tempest-VolumesSnapshotNegativeTestJSON-366505845 None] Lock "b'cinder-44d38516-c7b5-4a6f-9a4b-c3af0adb7159-delete_volume'" released by "delete_volume" :: held 3.298s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:40:31.918233 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:32.028457 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:32.028457 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:32.028457 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:32.042406 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Flow 'volume_create_manager' (897e3b3f-d4ef-4979-a8f8-73d113420d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:32.047118 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7505c95-c4ba-4d97-9c56-da3e1d994827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.084976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:32.115065 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7505c95-c4ba-4d97-9c56-da3e1d994827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-312296806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=c838fd1e-030d-4e95-b773-c01dcdb8122d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb8fa0489b6496683f560bd965ee2da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:32Z,user_id='0b634041fd7348cda4744c0aafaa4722',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.118066 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37b8a1b-039e-4c95-b2b1-3eae8bc32294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.130808 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37b8a1b-039e-4c95-b2b1-3eae8bc32294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.133580 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efad3f-991c-4854-9558-c05eb3133514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.137643 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08efad3f-991c-4854-9558-c05eb3133514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c838fd1e-030d-4e95-b773-c01dcdb8122d', 'volume_name': 'volume-c838fd1e-030d-4e95-b773-c01dcdb8122d', 'volume_size': 2}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.143958 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5901dafb-1924-4650-aab7-345c81fecb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.146593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5901dafb-1924-4650-aab7-345c81fecb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.149184 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29356bca-5897-48c9-a46f-7f35e64830f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.151812 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Volume c838fd1e-030d-4e95-b773-c01dcdb8122d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c838fd1e-030d-4e95-b773-c01dcdb8122d', 'volume_size': 2}
Jan 25 13:40:32.161690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c838fd1e-030d-4e95-b773-c01dcdb8122d stack-volumes-lvmdriver-1 -L 2g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:32.204883 n-d-760454-3 sudo[7724]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c838fd1e-030d-4e95-b773-c01dcdb8122d stack-volumes-lvmdriver-1 -L 2g
Jan 25 13:40:32.210436 n-d-760454-3 sudo[7724]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:32.231867 n-d-760454-3 sudo[7697]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:32.234263 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.680s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:32.238479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d3880b-344b-45fb-9081-8dce27d8e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.241145 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785fbcd4-4f73-4e1b-8326-cd47635a67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.287610 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Volume volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 (9926cc19-23c7-4dd7-80a4-e30a30bb4c37): created successfully
Jan 25 13:40:32.289860 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785fbcd4-4f73-4e1b-8326-cd47635a67c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.293221 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Flow 'volume_create_manager' (512a966e-0c80-481f-8c59-30d39f7d49be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:32.356020 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Created volume successfully.
Jan 25 13:40:32.802615 n-d-760454-3 sudo[7724]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:32.804417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-c838fd1e-030d-4e95-b773-c01dcdb8122d stack-volumes-lvmdriver-1 -L 2g" returned: 0 in 0.651s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:32.807144 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29356bca-5897-48c9-a46f-7f35e64830f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c838fd1e-030d-4e95-b773-c01dcdb8122d', 'volume_size': 2}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.809536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921af4dc-6e2b-4237-8d11-7de51eba3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:32.864832 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Volume volume-c838fd1e-030d-4e95-b773-c01dcdb8122d (c838fd1e-030d-4e95-b773-c01dcdb8122d): created successfully
Jan 25 13:40:32.867098 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921af4dc-6e2b-4237-8d11-7de51eba3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:32.870239 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Flow 'volume_create_manager' (897e3b3f-d4ef-4979-a8f8-73d113420d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:32.910346 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-eda549c0-b129-4e79-9a58-8019097fb01e tempest-VolumesCloneNegativeTest-452274468 None] Created volume successfully.
Jan 25 13:40:32.926315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:33.310288 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Lock "b'cinder-c838fd1e-030d-4e95-b773-c01dcdb8122d-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:33.443116 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Skipping remove_export. No iscsi_target is presently exported for volume: c838fd1e-030d-4e95-b773-c01dcdb8122d
Jan 25 13:40:33.444038 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:33.466310 n-d-760454-3 sudo[7763]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d
Jan 25 13:40:33.466868 n-d-760454-3 sudo[7763]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:33.491725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:33.512239 n-d-760454-3 sudo[7766]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:40:33.512847 n-d-760454-3 sudo[7766]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:33.919123 n-d-760454-3 sudo[7766]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:33.922204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37" returned: 0 in 0.430s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:33.984773 n-d-760454-3 sudo[7763]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:33.986269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:33.987292 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d" returned: 0 in 0.543s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:33.988961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.002003 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.002371 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355472]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:34.007489 n-d-760454-3 sudo[7773]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Targets prior to update: Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 39
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:40:34.007982 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:40:34.008004 n-d-760454-3 sudo[7773]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:34.011430 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Creating iscsi_target for Volume ID: volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Created volume path /opt/stack/data/cinder/volumes/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37,
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37>
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:     incominguser fCX3D4XmQshSsmYY6WYE br65MnmH3mQmHmW2
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:40:34.137921 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:40:34.140462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.142286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:34.367398 n-d-760454-3 sudo[7773]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:34.369650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d" returned: 0 in 0.381s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.371208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.388356 n-d-760454-3 sudo[7786]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d
Jan 25 13:40:34.389036 n-d-760454-3 sudo[7786]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:34.533611 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37" returned: 0 in 0.393s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.534283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355472]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:34.535179 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:40:34.535587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:40:34.539429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.544850 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.545370 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355472]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n            Backing store flags: \n    Account information:\n        fCX3D4XmQshSsmYY6WYE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Targets after update: Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 39
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:40:34.546170 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:40:34.549847 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.629618 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.081s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.630235 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355472]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n            Backing store flags: \n    Account information:\n        fCX3D4XmQshSsmYY6WYE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:34.634304 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:34.724265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.090s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.724887 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513355472]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n            Backing store flags: \n    Account information:\n        fCX3D4XmQshSsmYY6WYE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:40:34.726309 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:40:34.831670 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Initialize volume connection completed successfully.
Jan 25 13:40:34.976311 n-d-760454-3 sudo[7786]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:34.978218 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-c838fd1e-030d-4e95-b773-c01dcdb8122d" returned: 0 in 0.607s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:34.979703 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Successfully deleted volume: c838fd1e-030d-4e95-b773-c01dcdb8122d
Jan 25 13:40:35.159085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:35.207797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Created reservations ['dbbcf7a3-fa5c-4a93-bf32-46c1d40a2f17', '3292a952-e093-4a27-be74-cecf7e23791f', 'c4fc6e84-b26c-42ae-9495-baecefb7dd32', '6ab4a4aa-17e4-4b17-9654-8c4afc79177b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:35.210082 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:35.210082 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:35.210082 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:35.315957 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:35.316803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:35.334416 n-d-760454-3 sudo[7862]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:35.334956 n-d-760454-3 sudo[7862]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:35.699134 n-d-760454-3 sudo[7862]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:35.701816 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.384s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:35.703712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:35.721603 n-d-760454-3 sudo[7866]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:35.722123 n-d-760454-3 sudo[7866]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:36.174755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:36.223801 n-d-760454-3 sudo[7866]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:36.225745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:36.227527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:40:36.232978 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Deleted volume successfully.
Jan 25 13:40:36.287469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-eecdc1b4-b60b-4888-ae02-500717a8dc97 tempest-VolumesCloneNegativeTest-452274468 None] Lock "b'cinder-c838fd1e-030d-4e95-b773-c01dcdb8122d-delete_volume'" released by "delete_volume" :: held 2.977s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:40:37.183950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:38.197219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:39.214032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:39.863906 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:39.869068 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:39.869068 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:39.897199 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (4c8cecb5-2a05-433a-b3a3-ea084be8e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:39.899331 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14f9675-4332-451f-8323-f7d871d56434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:39.992909 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:40.042100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14f9675-4332-451f-8323-f7d871d56434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-104016934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=cd8710bf-ba9b-4374-b2b6-66ff331abf36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55e8bdb4a16428b869522b7e88ed652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:40Z,user_id='d2fe4934e5da4349b59d88ba30ec0338',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:40.042100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d3bd88-0c51-4048-9bae-ee29386b0bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:40.042100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d3bd88-0c51-4048-9bae-ee29386b0bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:40.042100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3bed80-e769-4fd4-8cb3-0bae3b299f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:40.046598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3bed80-e769-4fd4-8cb3-0bae3b299f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8710bf-ba9b-4374-b2b6-66ff331abf36', 'volume_name': 'volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:40.046598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a07a84-87f5-4150-97a7-b3da7250eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:40.052165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a07a84-87f5-4150-97a7-b3da7250eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:40.052165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951fa279-3843-4d04-9fde-196fe799a15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:40.052165 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Volume cd8710bf-ba9b-4374-b2b6-66ff331abf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36', 'volume_size': 1}
Jan 25 13:40:40.059162 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:40.096257 n-d-760454-3 sudo[7875]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:40:40.096864 n-d-760454-3 sudo[7875]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:40.222407 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:41.126134 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 1.070s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:41.128689 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951fa279-3843-4d04-9fde-196fe799a15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:41.121791 n-d-760454-3 sudo[7875]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:41.131533 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d6ece5-9c2f-44f5-81fc-8da7793d1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:41.200682 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Volume volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 (cd8710bf-ba9b-4374-b2b6-66ff331abf36): created successfully
Jan 25 13:40:41.200682 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d6ece5-9c2f-44f5-81fc-8da7793d1be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:41.210226 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (4c8cecb5-2a05-433a-b3a3-ea084be8e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:41.231288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:41.260756 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b22944d4-6bc2-4e1a-95fd-18d5e60cfee0 tempest-VolumesListTestJSON-1467549452 None] Created volume successfully.
Jan 25 13:40:42.245694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:43.251905 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:43.572453 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:43.578099 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:43.578099 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:43.614148 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (9ab02504-1dd2-4c64-bded-c2333b490bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:43.621573 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140a3de3-e494-40d3-a005-0f5a3a8263b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:43.646858 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:43.673952 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140a3de3-e494-40d3-a005-0f5a3a8263b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1245606615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=561a561a-b23f-4982-98b7-41ce759f7dab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55e8bdb4a16428b869522b7e88ed652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:43Z,user_id='d2fe4934e5da4349b59d88ba30ec0338',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:43.677585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c4d16-c199-458a-84f0-cca9da8ea4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:43.677585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c4d16-c199-458a-84f0-cca9da8ea4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:43.683132 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29924ae-438c-48fb-a31f-5cc6098b40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:43.683132 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29924ae-438c-48fb-a31f-5cc6098b40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561a561a-b23f-4982-98b7-41ce759f7dab', 'volume_name': 'volume-561a561a-b23f-4982-98b7-41ce759f7dab', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:43.689137 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f05ab54-42b3-4713-96ab-eb7b7ddb1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:43.689137 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f05ab54-42b3-4713-96ab-eb7b7ddb1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:43.692754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4540b8d9-f891-4b62-bc73-684c021c88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:43.692754 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Volume 561a561a-b23f-4982-98b7-41ce759f7dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561a561a-b23f-4982-98b7-41ce759f7dab', 'volume_size': 1}
Jan 25 13:40:43.692754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-561a561a-b23f-4982-98b7-41ce759f7dab stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:43.714870 n-d-760454-3 sudo[7923]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-561a561a-b23f-4982-98b7-41ce759f7dab stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:40:43.715621 n-d-760454-3 sudo[7923]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:44.263298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:44.360304 n-d-760454-3 sudo[7923]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:44.369485 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-561a561a-b23f-4982-98b7-41ce759f7dab stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.674s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:44.387437 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4540b8d9-f891-4b62-bc73-684c021c88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561a561a-b23f-4982-98b7-41ce759f7dab', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:44.387437 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72636748-c791-4c84-b996-2b4b4a78efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:44.432901 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Volume volume-561a561a-b23f-4982-98b7-41ce759f7dab (561a561a-b23f-4982-98b7-41ce759f7dab): created successfully
Jan 25 13:40:44.432901 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72636748-c791-4c84-b996-2b4b4a78efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:44.438990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (9ab02504-1dd2-4c64-bded-c2333b490bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:44.514943 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-835ff7a0-5ac8-4399-9c19-6631c9338d4a tempest-VolumesListTestJSON-1467549452 None] Created volume successfully.
Jan 25 13:40:45.264477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:45.804342 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:40:45.811389 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:40:45.811389 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:40:45.831279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (fe8e216a-409a-4acb-ae90-f8f3a8ed6993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:45.831279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e26bf4-d3ef-479b-af12-2f5d51520692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:45.858138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:40:45.898443 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e26bf4-d3ef-479b-af12-2f5d51520692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1380961255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b5ca90c5-4b6a-4990-8762-c29593e6804b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e55e8bdb4a16428b869522b7e88ed652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:40:45Z,user_id='d2fe4934e5da4349b59d88ba30ec0338',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:45.898443 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b1468-ee31-4c79-8e5f-2b546ee72686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:45.904394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b1468-ee31-4c79-8e5f-2b546ee72686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:45.904394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa266a8-8b98-4180-84d3-b74b3da5d3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:45.904394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa266a8-8b98-4180-84d3-b74b3da5d3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ca90c5-4b6a-4990-8762-c29593e6804b', 'volume_name': 'volume-b5ca90c5-4b6a-4990-8762-c29593e6804b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:45.910090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf2775-ebd7-4b04-ad63-42582da88d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:45.910090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf2775-ebd7-4b04-ad63-42582da88d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:45.916062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220f299d-4faa-47b6-839d-5a75d1702e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:45.916062 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Volume b5ca90c5-4b6a-4990-8762-c29593e6804b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ca90c5-4b6a-4990-8762-c29593e6804b', 'volume_size': 1}
Jan 25 13:40:45.916062 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b5ca90c5-4b6a-4990-8762-c29593e6804b stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:45.939859 n-d-760454-3 sudo[7956]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b5ca90c5-4b6a-4990-8762-c29593e6804b stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:40:45.940876 n-d-760454-3 sudo[7956]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:46.299635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:46.691232 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b5ca90c5-4b6a-4990-8762-c29593e6804b stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.777s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:46.689177 n-d-760454-3 sudo[7956]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:46.696319 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220f299d-4faa-47b6-839d-5a75d1702e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ca90c5-4b6a-4990-8762-c29593e6804b', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:46.698675 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcccbdb1-4e58-446e-9ab5-1344bedb0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:40:46.742398 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Volume volume-b5ca90c5-4b6a-4990-8762-c29593e6804b (b5ca90c5-4b6a-4990-8762-c29593e6804b): created successfully
Jan 25 13:40:46.742398 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcccbdb1-4e58-446e-9ab5-1344bedb0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:40:46.747606 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Flow 'volume_create_manager' (fe8e216a-409a-4acb-ae90-f8f3a8ed6993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:40:46.789865 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-832e3c12-6d76-48d0-b8c3-53a74cb2a047 tempest-VolumesListTestJSON-1467549452 None] Created volume successfully.
Jan 25 13:40:47.178745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:40:47.178745 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:47.184654 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:47.202490 n-d-760454-3 sudo[7991]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:47.203004 n-d-760454-3 sudo[7991]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:47.306571 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:47.574542 n-d-760454-3 sudo[7991]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:47.576388 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:47.578219 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:47.596087 n-d-760454-3 sudo[7995]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:47.596764 n-d-760454-3 sudo[7995]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:48.326646 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:48.375900 n-d-760454-3 sudo[7995]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:48.379190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:48.382246 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:40:49.335446 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:50.346896 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:51.353039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:52.354304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:52.466454 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-b5ca90c5-4b6a-4990-8762-c29593e6804b-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:52.681041 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Skipping remove_export. No iscsi_target is presently exported for volume: b5ca90c5-4b6a-4990-8762-c29593e6804b
Jan 25 13:40:52.682178 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:52.705749 n-d-760454-3 sudo[8001]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b
Jan 25 13:40:52.707249 n-d-760454-3 sudo[8001]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:53.393310 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:53.877172 n-d-760454-3 sudo[8001]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:53.891310 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b" returned: 0 in 1.200s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:53.891310 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:53.928082 n-d-760454-3 sudo[8005]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b
Jan 25 13:40:53.928833 n-d-760454-3 sudo[8005]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:54.392101 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:54.406518 n-d-760454-3 sudo[8005]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:54.412144 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b" returned: 0 in 0.522s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:54.412144 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:54.429898 n-d-760454-3 sudo[8009]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b
Jan 25 13:40:54.430521 n-d-760454-3 sudo[8009]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:55.309217 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b5ca90c5-4b6a-4990-8762-c29593e6804b" returned: 0 in 0.891s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:55.309217 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Successfully deleted volume: b5ca90c5-4b6a-4990-8762-c29593e6804b
Jan 25 13:40:55.298890 n-d-760454-3 sudo[8009]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:55.407688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Created reservations ['d54bd9b2-e339-47d8-8518-d689fd62fd44', 'f6de5249-70d9-45cb-9c0d-bd6e5bde0af3', '6c48ee0c-b353-446a-b793-803f837c45f6', '662d2292-e4d8-4a20-be92-5626d4dd5dfe'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:55.434199 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:55.434199 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:55.434199 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:55.434199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:55.584310 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:55.584310 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:55.596006 n-d-760454-3 sudo[8018]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:55.596740 n-d-760454-3 sudo[8018]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:56.105970 n-d-760454-3 sudo[8018]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:56.113726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:56.113726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:56.139371 n-d-760454-3 sudo[8022]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:56.140277 n-d-760454-3 sudo[8022]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:56.430165 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-561a561a-b23f-4982-98b7-41ce759f7dab-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:56.460443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:56.622124 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Skipping remove_export. No iscsi_target is presently exported for volume: 561a561a-b23f-4982-98b7-41ce759f7dab
Jan 25 13:40:56.622124 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:56.640572 n-d-760454-3 sudo[8028]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab
Jan 25 13:40:56.641113 n-d-760454-3 sudo[8028]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:56.969963 n-d-760454-3 sudo[8022]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:56.978872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.861s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:56.978872 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:40:56.991726 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Deleted volume successfully.
Jan 25 13:40:57.071271 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-86717550-3bc8-4ccd-8695-87df3dfb36dc tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-b5ca90c5-4b6a-4990-8762-c29593e6804b-delete_volume'" released by "delete_volume" :: held 4.599s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:40:57.427752 n-d-760454-3 sudo[8028]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:57.429887 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab" returned: 0 in 0.811s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:57.431587 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:57.452855 n-d-760454-3 sudo[8032]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab
Jan 25 13:40:57.453435 n-d-760454-3 sudo[8032]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:57.474942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:57.960035 n-d-760454-3 sudo[8032]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:57.972457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab" returned: 0 in 0.531s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:57.972457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:57.999746 n-d-760454-3 sudo[8036]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab
Jan 25 13:40:58.000605 n-d-760454-3 sudo[8036]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:58.506808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:58.756395 n-d-760454-3 sudo[8036]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:58.759307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-561a561a-b23f-4982-98b7-41ce759f7dab" returned: 0 in 0.793s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:58.762402 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Successfully deleted volume: 561a561a-b23f-4982-98b7-41ce759f7dab
Jan 25 13:40:58.861274 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Created reservations ['f567da2b-d738-4d96-b04a-38b457c9dea3', '990de4dc-a424-4803-9ef8-120bae1dbbcb', 'a7b5b05e-51e5-410e-b227-663279e38bb7', 'fd8807f3-8dd9-40e9-a53c-49f3ae7f9df9'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:40:58.861274 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:40:58.861274 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:40:58.861274 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:40:59.035876 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:40:59.035876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:59.046940 n-d-760454-3 sudo[8046]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:40:59.047461 n-d-760454-3 sudo[8046]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:59.151138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-cd8710bf-ba9b-4374-b2b6-66ff331abf36-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:40:59.299920 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Skipping remove_export. No iscsi_target is presently exported for volume: cd8710bf-ba9b-4374-b2b6-66ff331abf36
Jan 25 13:40:59.299920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:59.323038 n-d-760454-3 sudo[8048]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36
Jan 25 13:40:59.323565 n-d-760454-3 sudo[8048]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:40:59.476839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:40:59.476839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:40:59.470801 n-d-760454-3 sudo[8046]: pam_unix(sudo:session): session closed for user root
Jan 25 13:40:59.525376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:40:59.521261 n-d-760454-3 sudo[8052]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:40:59.522043 n-d-760454-3 sudo[8052]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:00.318425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36" returned: 0 in 1.020s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:00.318425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:00.308709 n-d-760454-3 sudo[8048]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:00.339036 n-d-760454-3 sudo[8058]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36
Jan 25 13:41:00.339591 n-d-760454-3 sudo[8058]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:00.431883 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.952s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:00.431883 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:00.425226 n-d-760454-3 sudo[8052]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:00.461796 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Deleted volume successfully.
Jan 25 13:41:00.524868 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7afbecfb-e70f-47bc-abd8-27638f451828 tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-561a561a-b23f-4982-98b7-41ce759f7dab-delete_volume'" released by "delete_volume" :: held 4.093s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:41:00.530159 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:00.771965 n-d-760454-3 sudo[8058]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:00.773975 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36" returned: 0 in 0.462s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:00.777558 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:00.792798 n-d-760454-3 sudo[8062]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36
Jan 25 13:41:00.793453 n-d-760454-3 sudo[8062]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:01.538960 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:02.305884 n-d-760454-3 sudo[8062]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:02.324598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cd8710bf-ba9b-4374-b2b6-66ff331abf36" returned: 0 in 1.532s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:02.324598 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Successfully deleted volume: cd8710bf-ba9b-4374-b2b6-66ff331abf36
Jan 25 13:41:02.430261 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Created reservations ['634c5352-8590-484b-a631-2132512aaa5d', '6443c6f9-5da0-4bd2-a764-5143221bcc65', 'b1d3a762-7a41-4fc0-8fd9-a425dc3e7d58', 'f00292ab-cb0c-4aa7-b992-0e966f3a7479'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:41:02.432910 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:41:02.432910 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:41:02.432910 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:41:02.550773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:02.661404 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:41:02.661404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:02.674670 n-d-760454-3 sudo[8071]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:41:02.676498 n-d-760454-3 sudo[8071]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:03.142107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:03.144019 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:03.138915 n-d-760454-3 sudo[8071]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:03.161290 n-d-760454-3 sudo[8075]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:41:03.161911 n-d-760454-3 sudo[8075]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:03.558995 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:04.007801 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.859s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:04.007801 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:04.000645 n-d-760454-3 sudo[8075]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:04.020584 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Deleted volume successfully.
Jan 25 13:41:04.066910 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3c56d323-9cce-43a8-ab0e-05f38a031707 tempest-VolumesListTestJSON-1467549452 None] Lock "b'cinder-cd8710bf-ba9b-4374-b2b6-66ff331abf36-delete_volume'" released by "delete_volume" :: held 4.917s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:41:04.565986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:05.568605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:05.646674 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Terminate volume connection completed successfully.
Jan 25 13:41:05.705340 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:05.792122 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.087s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:05.792615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37\n            Backing store flags: \n    Account information:\n        fCX3D4XmQshSsmYY6WYE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:05.793381 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Removing iscsi_target for Volume ID: 9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:05.794630 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:06.114526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 -f" returned: 0 in 0.319s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:06.114900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:06.116522 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:06.206163 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.089s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:06.206754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:06.207988 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-11436779-5ffc-4787-836e-c728ec576325 tempest-VolumesBackupsTest-1355027314 None] Remove volume export completed successfully.
Jan 25 13:41:06.575031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:07.120764 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-9926cc19-23c7-4dd7-80a4-e30a30bb4c37-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:41:07.235966 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:07.322514 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.083s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:07.322843 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:07.323564 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Skipping remove_export. No iscsi_target is presently exported for volume: 9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:07.324522 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:07.341722 n-d-760454-3 sudo[8120]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:07.342335 n-d-760454-3 sudo[8120]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:07.591932 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:08.008168 n-d-760454-3 sudo[8120]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:08.010132 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37" returned: 0 in 0.685s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:08.011706 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:08.029000 n-d-760454-3 sudo[8124]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:08.029630 n-d-760454-3 sudo[8124]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:08.446951 n-d-760454-3 sudo[8124]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:08.449362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37" returned: 0 in 0.438s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:08.454654 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:08.481408 n-d-760454-3 sudo[8128]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:08.482069 n-d-760454-3 sudo[8128]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:08.601256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:09.157650 n-d-760454-3 sudo[8128]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:09.165690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-9926cc19-23c7-4dd7-80a4-e30a30bb4c37" returned: 0 in 0.707s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:09.165690 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: 9926cc19-23c7-4dd7-80a4-e30a30bb4c37
Jan 25 13:41:09.248164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Created reservations ['cb65387a-f640-4151-81f4-e28c14be1fae', '15fe4151-2490-4529-b4d6-132447830d9e', '97b2abf0-5646-42f2-9f12-9801884ea981', '62812324-50f7-4a22-af71-148921708e5c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:41:09.250727 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:41:09.250727 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:41:09.250727 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:41:09.607906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:09.620815 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:41:09.620815 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:09.662783 n-d-760454-3 sudo[8144]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:41:09.665565 n-d-760454-3 sudo[8144]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:09.830044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-5eb4b2d2-8919-49a0-a153-90b75d019238-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:41:10.000348 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:10.091513 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.091s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:10.092001 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356384]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:10.092868 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Skipping remove_export. No iscsi_target is presently exported for volume: 5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:41:10.094079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:10.120513 n-d-760454-3 sudo[8170]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:41:10.122364 n-d-760454-3 sudo[8170]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:10.162904 n-d-760454-3 sudo[8144]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:10.166121 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:10.173646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:10.195118 n-d-760454-3 sudo[8173]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:41:10.196279 n-d-760454-3 sudo[8173]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:10.619248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:10.867967 n-d-760454-3 sudo[8170]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:10.870414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238" returned: 0 in 0.776s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:10.871793 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:10.904112 n-d-760454-3 sudo[8193]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:41:10.905195 n-d-760454-3 sudo[8193]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:10.937648 n-d-760454-3 sudo[8173]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:10.940184 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.772s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:10.944493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:10.967739 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:41:11.035581 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c3ff9b95-9a3c-4bdf-a1c8-b8d47bbfac65 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-9926cc19-23c7-4dd7-80a4-e30a30bb4c37-delete_volume'" released by "delete_volume" :: held 3.909s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:41:11.349653 n-d-760454-3 sudo[8193]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:11.354678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238" returned: 0 in 0.480s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:11.354678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:11.375911 n-d-760454-3 sudo[8203]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:41:11.376949 n-d-760454-3 sudo[8203]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:11.633059 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:12.115177 n-d-760454-3 sudo[8203]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:12.119522 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5eb4b2d2-8919-49a0-a153-90b75d019238" returned: 0 in 0.764s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:12.125937 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: 5eb4b2d2-8919-49a0-a153-90b75d019238
Jan 25 13:41:12.286798 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Created reservations ['c07b459c-9f96-4d07-9363-3be03d19c2ca', '9abe6c14-872c-45f5-a960-add49eb02fc8', 'fe8e1650-8b23-41d0-8057-600e96ff89af', '8ac5703c-a478-46c5-be09-63212600102e'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:41:12.290014 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:41:12.290014 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:41:12.290014 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:41:12.449671 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:41:12.449671 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:12.469042 n-d-760454-3 sudo[8241]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:41:12.470195 n-d-760454-3 sudo[8241]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:12.651390 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:12.912517 n-d-760454-3 sudo[8241]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:12.914533 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:12.916092 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:12.952572 n-d-760454-3 sudo[8245]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:41:12.954488 n-d-760454-3 sudo[8245]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:13.631935 n-d-760454-3 sudo[8245]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:13.634259 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:13.637106 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:13.645026 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:41:13.683042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:13.690510 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-b0a84695-2a50-47dd-a178-af956c05ae7b-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:41:13.709617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-d94446aa-dd29-49e2-a44f-426371daabf0 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-5eb4b2d2-8919-49a0-a153-90b75d019238-delete_volume'" released by "delete_volume" :: held 3.880s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:41:13.825353 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:13.919680 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.094s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:13.920150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:41:13.921204 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Skipping remove_export. No iscsi_target is presently exported for volume: b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:41:13.922365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:13.942496 n-d-760454-3 sudo[8251]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:41:13.943693 n-d-760454-3 sudo[8251]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:14.576257 n-d-760454-3 sudo[8251]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:14.578656 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b" returned: 0 in 0.656s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:14.580446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:14.603608 n-d-760454-3 sudo[8263]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:41:14.604166 n-d-760454-3 sudo[8263]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:14.692056 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:15.038143 n-d-760454-3 sudo[8263]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:15.040142 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b" returned: 0 in 0.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:15.042216 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:15.062428 n-d-760454-3 sudo[8269]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:41:15.062990 n-d-760454-3 sudo[8269]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:15.705811 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:15.740445 n-d-760454-3 sudo[8269]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:15.742689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b0a84695-2a50-47dd-a178-af956c05ae7b" returned: 0 in 0.700s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:15.743937 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Successfully deleted volume: b0a84695-2a50-47dd-a178-af956c05ae7b
Jan 25 13:41:15.862363 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Created reservations ['eb3a2308-6fa0-47e4-a07d-c8b6e2ad3098', '73d90ddf-e6c9-4d34-abae-199e134ed90e', '05f99be6-2a11-4c1d-b9e1-0130190a3d13', '14b7bbf5-871d-4881-8fe6-eac77ca258a1'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:41:15.862363 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:41:15.862363 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:41:15.862363 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:41:16.098536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:41:16.107746 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:16.135393 n-d-760454-3 sudo[8316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:41:16.135908 n-d-760454-3 sudo[8316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:16.669084 n-d-760454-3 sudo[8316]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:16.671382 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:16.673709 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:16.692849 n-d-760454-3 sudo[8352]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:41:16.693485 n-d-760454-3 sudo[8352]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:16.722424 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:17.336109 n-d-760454-3 sudo[8352]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:17.342003 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:17.342003 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:17.354485 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Deleted volume successfully.
Jan 25 13:41:17.407398 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-7f84462d-5631-4679-a05a-d2f6f6b88462 tempest-VolumesBackupsTest-1355027314 None] Lock "b'cinder-b0a84695-2a50-47dd-a178-af956c05ae7b-delete_volume'" released by "delete_volume" :: held 3.717s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:41:17.721365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:18.733146 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:19.740171 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:20.752712 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:21.760156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:22.770145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:23.779079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:24.786075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:25.043573 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:41:25.048361 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:41:25.048936 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:41:25.063159 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (179ffe3d-44ab-44fb-a7bd-9696c4ac66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:41:25.066954 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c34c34-936d-4946-9c7c-8c1eb350c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:25.096307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:41:25.132035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c34c34-936d-4946-9c7c-8c1eb350c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897116261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=d7a6347d-1f38-407a-8948-a144b22f09f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:41:25Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:25.134729 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523fb35-f82b-4c9f-bb6f-db987271891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:25.137119 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7523fb35-f82b-4c9f-bb6f-db987271891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:25.140212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e69242-8d50-40ef-8501-c0bf8061fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:25.142641 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e69242-8d50-40ef-8501-c0bf8061fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a6347d-1f38-407a-8948-a144b22f09f6', 'volume_name': 'volume-d7a6347d-1f38-407a-8948-a144b22f09f6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:25.145111 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97459f3d-a5d2-49c7-8978-5d5a6559f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:25.147316 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97459f3d-a5d2-49c7-8978-5d5a6559f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:25.149697 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbee62-8a9c-4f84-8091-6af829ec299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:25.150539 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Volume d7a6347d-1f38-407a-8948-a144b22f09f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a6347d-1f38-407a-8948-a144b22f09f6', 'volume_size': 1}
Jan 25 13:41:25.151622 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-d7a6347d-1f38-407a-8948-a144b22f09f6 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:25.169718 n-d-760454-3 sudo[8497]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-d7a6347d-1f38-407a-8948-a144b22f09f6 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:41:25.170474 n-d-760454-3 sudo[8497]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:25.799414 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:25.946242 n-d-760454-3 sudo[8497]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:25.950942 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-d7a6347d-1f38-407a-8948-a144b22f09f6 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.797s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:25.959912 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febbee62-8a9c-4f84-8091-6af829ec299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a6347d-1f38-407a-8948-a144b22f09f6', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:25.963947 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcc25a2-a2ba-404d-9837-242fbf7296ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:41:26.001895 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-d7a6347d-1f38-407a-8948-a144b22f09f6 (d7a6347d-1f38-407a-8948-a144b22f09f6): created successfully
Jan 25 13:41:26.005052 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcc25a2-a2ba-404d-9837-242fbf7296ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:41:26.010493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (179ffe3d-44ab-44fb-a7bd-9696c4ac66ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:41:26.053383 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1da3812b-4e58-4725-92a0-ff80fa0b0c3d tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:41:26.805730 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:27.791131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1c44fd0-dce5-492c-9460-017736ad4807 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:27.811369 n-d-760454-3 sudo[8579]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:41:27.812647 n-d-760454-3 sudo[8579]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:27.815619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:28.538351 n-d-760454-3 sudo[8579]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:28.540303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1c44fd0-dce5-492c-9460-017736ad4807 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.749s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:28.550516 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1c44fd0-dce5-492c-9460-017736ad4807 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:28.560368 n-d-760454-3 sudo[8587]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g
Jan 25 13:41:28.560927 n-d-760454-3 sudo[8587]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:28.829568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:29.836631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:29.905023 n-d-760454-3 sudo[8587]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:29.907390 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d1c44fd0-dce5-492c-9460-017736ad4807 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g" returned: 0 in 1.365s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:30.012640 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d1c44fd0-dce5-492c-9460-017736ad4807 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:41:30.842279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:31.802644 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.driver [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Creating a new backup for volume volume-d7a6347d-1f38-407a-8948-a144b22f09f6. {{(pid=89244) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1215}}
Jan 25 13:41:31.848056 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:31.925972 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:31.944125 n-d-760454-3 sudo[8772]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:41:31.944792 n-d-760454-3 sudo[8772]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:32.748139 n-d-760454-3 sudo[8772]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:32.750619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.824s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:32.752420 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:32.770427 n-d-760454-3 sudo[8816]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3
Jan 25 13:41:32.771031 n-d-760454-3 sudo[8816]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:32.855754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:33.172245 n-d-760454-3 sudo[8816]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:33.174133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3" returned: 0 in 0.422s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:33.176690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:33.197395 n-d-760454-3 sudo[8822]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe iflag=direct
Jan 25 13:41:33.198048 n-d-760454-3 sudo[8822]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:33.584967 n-d-760454-3 sudo[8822]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:33.587287 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe iflag=direct" returned: 0 in 0.410s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:33.588881 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:33.608604 n-d-760454-3 sudo[8832]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe oflag=direct
Jan 25 13:41:33.609155 n-d-760454-3 sudo[8832]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:33.878013 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:33.978751 n-d-760454-3 sudo[8832]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:33.980664 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe oflag=direct" returned: 0 in 0.392s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:33.982131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:34.002082 n-d-760454-3 sudo[8838]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:41:34.004355 n-d-760454-3 sudo[8838]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:34.897682 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:35.917539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:36.935248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:37.941192 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:38.946537 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:39.955230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:40.965795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:41.978543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:42.986699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:43.993559 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:44.999702 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:46.006096 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:47.012100 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:47.173458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:41:47.173978 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:41:47.175538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:47.194747 n-d-760454-3 sudo[9020]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:41:47.195312 n-d-760454-3 sudo[9020]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:47.712044 n-d-760454-3 sudo[9020]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:47.716282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:47.717766 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:41:47.740144 n-d-760454-3 sudo[9024]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:41:47.740886 n-d-760454-3 sudo[9024]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:41:48.022646 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:49.028268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:50.034052 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:50.458723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.726s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:41:50.458723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:41:50.442059 n-d-760454-3 sudo[9024]: pam_unix(sudo:session): session closed for user root
Jan 25 13:41:51.039690 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:52.045861 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:53.051615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:54.058015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:55.063807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:56.070533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:57.075712 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:58.092400 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:41:59.086789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:00.093387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:01.104523 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:02.111165 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:03.117847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:04.126725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:05.133354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:06.138419 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:07.144318 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:08.149087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:09.155483 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:09.883958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 35.902s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:09.884582 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--dd887af0--ea6b--4109--b16f--ff449c96e0a3, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--e679b021--e80a--4f90--a0ad--9e0a24c5babe, size 1024.00 MB, duration 35.90 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:42:09.884999 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy 1024.00 MB at 28.52 MB/s
Jan 25 13:42:10.045090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:10.081602 n-d-760454-3 sudo[9174]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:42:10.082330 n-d-760454-3 sudo[9174]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:42:10.166465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:10.649598 n-d-760454-3 sudo[9174]: pam_unix(sudo:session): session closed for user root
Jan 25 13:42:10.651531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe" returned: 0 in 0.606s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:10.711766 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:10.727339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.019s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:10.727711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Targets prior to update: Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 39
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:42:10.728397 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:42:10.731898 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Creating iscsi_target for Volume ID: volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume path /opt/stack/data/cinder/volumes/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe,
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe>
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:     incominguser L9meRac7joz5AVZ7PdMg SU6JBf7MdwBP4AXA
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:42:10.817917 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:42:10.827834 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:11.172141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:11.282143 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe" returned: 0 in 0.462s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:11.282711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:42:11.283602 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:42:11.284120 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:42:11.288239 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:11.300995 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.014s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:11.301527 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n            Backing store flags: \n    Account information:\n        L9meRac7joz5AVZ7PdMg\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Targets after update: Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 39
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.18
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020000
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf20
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00020001
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf21
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:42:11.302424 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:42:11.311238 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:11.445180 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.128s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:11.445486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n            Backing store flags: \n    Account information:\n        L9meRac7joz5AVZ7PdMg\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:42:11.446924 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:11.562481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.113s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:11.562481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n            Backing store flags: \n    Account information:\n        L9meRac7joz5AVZ7PdMg\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:42:11.563598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Set provider_location to: 10.222.0.65:3260,3 iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:42:11.664373 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Initialize volume connection completed successfully.
Jan 25 13:42:12.177636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:13.187495 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:14.190365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:15.195839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:16.201586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:17.207450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:18.213612 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:19.220109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:20.228145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:26.573482 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:27.266839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:28.273999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:29.280367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:30.285811 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:31.292348 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:32.301327 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:33.310716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:34.315500 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:35.327770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:36.331704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:37.337425 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:38.344223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:39.352679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:40.358888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:41.365847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:42.371961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:43.377939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:44.383911 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:45.389732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:46.395499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:47.172231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:42:47.172686 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:42:47.173483 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:47.195119 n-d-760454-3 sudo[9470]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:42:47.200858 n-d-760454-3 sudo[9470]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:42:47.403948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:47.567997 n-d-760454-3 sudo[9470]: pam_unix(sudo:session): session closed for user root
Jan 25 13:42:47.569773 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.396s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:47.570903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:42:47.588863 n-d-760454-3 sudo[9474]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:42:47.589425 n-d-760454-3 sudo[9474]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:42:48.412296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:48.541690 n-d-760454-3 sudo[9474]: pam_unix(sudo:session): session closed for user root
Jan 25 13:42:48.543646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.973s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:42:48.544496 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:42:49.417278 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:50.423643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:51.429722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:52.436054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:53.441721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:54.447184 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:55.455647 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:56.462484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:57.469204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:58.485743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:42:59.492466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:00.498879 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:01.505256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:02.512970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:03.520470 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:04.524940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:05.544105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:06.546279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:07.551757 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:08.560797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:09.565740 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:10.572325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:11.578246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:12.491684 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Terminate volume connection completed successfully.
Jan 25 13:43:12.552814 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:12.592711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:12.630907 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-e679b021-e80a-4f90-a0ad-9e0a24c5babe-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:43:12.673634 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.119s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:12.674060 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 3: iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00030000\n            SCSI SN: beaf30\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00030001\n            SCSI SN: beaf31\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe\n            Backing store flags: \n    Account information:\n        L9meRac7joz5AVZ7PdMg\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:12.674894 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Removing iscsi_target for Volume ID: e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:12.699033 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:12.703929 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Trying to delete temp volume: e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:12.706264 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:12.935721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.229s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:12.936774 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357144]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:12.937392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe -f" returned: 0 in 0.259s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:12.938107 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:12.939347 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:12.940819 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:12.964801 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:12.968316 n-d-760454-3 sudo[9527]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:12.969951 n-d-760454-3 sudo[9527]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:13.103306 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.142s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:13.103696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 39\n            Initiator: iqn.1991-05.com.microsoft:n-h1-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.18\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:13.105384 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Remove volume export completed successfully.
Jan 25 13:43:13.606730 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:13.683939 n-d-760454-3 sudo[9527]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:13.686114 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe" returned: 0 in 0.746s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:13.687813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:13.709823 n-d-760454-3 sudo[9538]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:13.710395 n-d-760454-3 sudo[9538]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:14.243384 n-d-760454-3 sudo[9538]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:14.247353 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe" returned: 0 in 0.558s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:14.251221 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:14.278428 n-d-760454-3 sudo[9542]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:14.278982 n-d-760454-3 sudo[9542]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:14.625708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:14.914309 n-d-760454-3 sudo[9542]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:14.916309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e679b021-e80a-4f90-a0ad-9e0a24c5babe" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:14.918450 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: e679b021-e80a-4f90-a0ad-9e0a24c5babe
Jan 25 13:43:14.922637 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:43:14.922637 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:43:14.922637 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:43:14.981759 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:43:14.991310 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-a95a0e0f-0635-4124-8c8f-2bcf089cd4a7 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-e679b021-e80a-4f90-a0ad-9e0a24c5babe-delete_volume'" released by "delete_volume" :: held 2.360s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:43:15.635328 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:16.644241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:17.678246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:18.657517 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:19.665886 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:20.676292 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:21.682725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:22.689219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:23.695487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:24.704018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:25.711270 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:26.717350 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:27.725725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:28.734382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:29.739973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:30.219934 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:43:30.224572 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:43:30.225133 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:43:30.238833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (3fce4e38-951d-4b46-9dc4-798ce4892b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:43:30.242634 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec375cd-9415-44fa-8c01-41eb33dc7133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:43:30.268289 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:43:30.295652 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec375cd-9415-44fa-8c01-41eb33dc7133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-52358602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=b9761505-e4d6-4abf-9638-72ef80fa8531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:43:30Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:43:30.298409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ab1293-6ece-48c0-a017-c7c511debd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:43:30.300671 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ab1293-6ece-48c0-a017-c7c511debd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:43:30.303142 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d79e760-d771-4373-97b2-36d2124276d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:43:30.405831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d79e760-d771-4373-97b2-36d2124276d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9761505-e4d6-4abf-9638-72ef80fa8531', 'volume_name': 'volume-b9761505-e4d6-4abf-9638-72ef80fa8531', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4e5400>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:43:30.408286 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4727639e-343b-4406-9558-a618c5d73a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:43:30.410633 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4727639e-343b-4406-9558-a618c5d73a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:43:30.412970 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4ba87-919c-4fe2-b19c-9ee190d8fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:43:30.413862 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Volume b9761505-e4d6-4abf-9638-72ef80fa8531: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9761505-e4d6-4abf-9638-72ef80fa8531', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4e5400>}
Jan 25 13:43:30.414625 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Cloning b9761505-e4d6-4abf-9638-72ef80fa8531 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 13:43:30.747057 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:31.755735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:32.764785 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:33.770702 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:34.778442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:35.802493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:36.810332 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:37.821895 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:38.832593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:39.837970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:40.844230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:43.615471 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1, size 616.00 MB, duration 13.20 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 13:43:43.616153 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Image download 616.00 MB at 46.67 MB/s
Jan 25 13:43:43.624809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:43.674195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:43.771277 n-d-760454-3 sudo[9577]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1
Jan 25 13:43:43.771905 n-d-760454-3 sudo[9577]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:44.138902 n-d-760454-3 sudo[9577]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:44.141268 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1" returned: 0 in 0.467s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:44.142259 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user ae3b578a2d074b598c9209fb96102995. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 13:43:44.231031 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:44.327336 n-d-760454-3 sudo[9581]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1
Jan 25 13:43:44.327876 n-d-760454-3 sudo[9581]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:44.631900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:44.675970 n-d-760454-3 sudo[9581]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:44.678048 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1" returned: 0 in 0.447s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:44.680043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b9761505-e4d6-4abf-9638-72ef80fa8531 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:44.697209 n-d-760454-3 sudo[9585]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b9761505-e4d6-4abf-9638-72ef80fa8531 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:43:44.698324 n-d-760454-3 sudo[9585]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:45.290161 n-d-760454-3 sudo[9585]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:45.293014 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-b9761505-e4d6-4abf-9638-72ef80fa8531 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.613s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:45.418580 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume b9761505-e4d6-4abf-9638-72ef80fa8531. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 13:43:45.465099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp0mlmgbzx {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:45.565118 n-d-760454-3 sudo[9616]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp0mlmgbzx
Jan 25 13:43:45.565666 n-d-760454-3 sudo[9616]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:45.640391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:45.922721 n-d-760454-3 sudo[9616]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:45.924845 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmp0mlmgbzx" returned: 0 in 0.460s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:45.926191 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:46.022641 n-d-760454-3 sudo[9619]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1
Jan 25 13:43:46.023219 n-d-760454-3 sudo[9619]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:46.367716 n-d-760454-3 sudo[9619]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:46.370076 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1" returned: 0 in 0.443s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:46.370950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 13:43:46.371992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:46.389743 n-d-760454-3 sudo[9623]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531 oflag=direct
Jan 25 13:43:46.390279 n-d-760454-3 sudo[9623]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:46.647889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:46.743146 n-d-760454-3 sudo[9623]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:46.746762 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531 oflag=direct" returned: 0 in 0.375s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:46.748715 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:46.767333 n-d-760454-3 sudo[9635]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531
Jan 25 13:43:46.767903 n-d-760454-3 sudo[9635]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:47.172356 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:43:47.172867 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:43:47.173754 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:47.190068 n-d-760454-3 sudo[9650]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:43:47.190671 n-d-760454-3 sudo[9650]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:47.542012 n-d-760454-3 sudo[9650]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:47.544137 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:47.545417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:47.562381 n-d-760454-3 sudo[9658]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:43:47.562957 n-d-760454-3 sudo[9658]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:43:47.655343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:48.327394 n-d-760454-3 sudo[9658]: pam_unix(sudo:session): session closed for user root
Jan 25 13:43:48.329176 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.784s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:48.330726 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:43:48.661698 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:49.668378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:50.987193 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:51.679616 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:52.685553 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:53.691141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:54.696080 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:55.719336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:56.058222 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-2e532ebe-078c-4b07-85c8-52a901daa38f req-7e60b094-4144-4ed4-b9ad-562541ccacbb tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:43:56.058825 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-2e532ebe-078c-4b07-85c8-52a901daa38f req-7e60b094-4144-4ed4-b9ad-562541ccacbb tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 2433e162-a43c-41b4-8506-f761cbc1e5f2. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:43:56.060662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:56.138653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:56.139036 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 2: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:56.139732 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-2e532ebe-078c-4b07-85c8-52a901daa38f req-7e60b094-4144-4ed4-b9ad-562541ccacbb tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: 94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:43:56.141144 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:56.242427 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -f" returned: 0 in 0.101s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:56.242907 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:56.245717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:43:56.336510 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.090s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:43:56.336993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:43:56.543087 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-2e532ebe-078c-4b07-85c8-52a901daa38f req-7e60b094-4144-4ed4-b9ad-562541ccacbb tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:43:56.543087 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:43:56.543087 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:43:56.711268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:57.716682 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:58.722104 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:43:59.727746 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:00.733201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:01.739023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:02.744060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:03.753540 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:03.825823 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:03.842331 n-d-760454-3 sudo[9713]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:03.842963 n-d-760454-3 sudo[9713]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:04.206959 n-d-760454-3 sudo[9713]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:04.209303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.383s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:04.264646 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:04.270447 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:04.270823 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:04.271484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:44:04.272434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576,
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576>
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:     incominguser 6QhmEtbJv5sWJe8siis4 FrJCSKPiLj2Qszqp
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:44:04.497279 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:44:04.498743 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:04.760946 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:04.870105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.370s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:04.870668 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:04.872161 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:44:04.872802 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:44:04.874384 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:04.890077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.012s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:04.890077 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:04.890077 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:44:04.890421 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:04.971158 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.081s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:04.971784 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:04.973188 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:05.056396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.083s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:05.056859 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356536]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:05.058001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:44:05.645740 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-ad559c54-4d02-4aca-b4ce-2aedfd328053 req-eb7bc603-7244-4bf0-a3e1-ca61d2d07ba3 tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:44:05.768803 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:06.774653 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:07.781128 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:07.843329 n-d-760454-3 sudo[9635]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:07.845792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531" returned: 0 in 21.097s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:07.846936 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:07.944130 n-d-760454-3 sudo[9791]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1
Jan 25 13:44:07.944696 n-d-760454-3 sudo[9791]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:08.300178 n-d-760454-3 sudo[9791]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:08.302534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1" returned: 0 in 0.455s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:08.303444 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpfhf1ptvon-d-760454-3@lvmdriver-1, size 700.00 MB, duration 21.10 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--b9761505--e4d6--4abf--9638--72ef80fa8531 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 13:44:08.304039 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Converted 700.00 MB image at 33.18 MB/s
Jan 25 13:44:08.304747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume b9761505-e4d6-4abf-9638-72ef80fa8531 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 13:44:08.426076 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user ae3b578a2d074b598c9209fb96102995 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 13:44:08.426832 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Marking volume b9761505-e4d6-4abf-9638-72ef80fa8531 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:44:08.471237 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to b9761505-e4d6-4abf-9638-72ef80fa8531. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 13:44:08.471669 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Creating volume glance metadata for volume b9761505-e4d6-4abf-9638-72ef80fa8531 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 13:44:08.602761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4ba87-919c-4fe2-b19c-9ee190d8fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9761505-e4d6-4abf-9638-72ef80fa8531', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c4e5400>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:44:08.605973 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471799c6-fda6-4a9c-b685-2cda88082c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:44:08.631145 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-b9761505-e4d6-4abf-9638-72ef80fa8531 (b9761505-e4d6-4abf-9638-72ef80fa8531): created successfully
Jan 25 13:44:08.634897 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471799c6-fda6-4a9c-b685-2cda88082c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:44:08.640677 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (3fce4e38-951d-4b46-9dc4-798ce4892b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:44:08.676717 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6e62f5fc-5f9f-4bf2-9c6e-5e19a823bc8f tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:44:08.786935 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:09.794043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:10.030891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:10.047229 n-d-760454-3 sudo[9796]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:10.047802 n-d-760454-3 sudo[9796]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:10.407786 n-d-760454-3 sudo[9796]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:10.410279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.379s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:10.467552 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:10.474258 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:10.474629 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:44:10.475315 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:44:10.478666 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Creating iscsi_target for Volume ID: volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume path /opt/stack/data/cinder/volumes/volume-b9761505-e4d6-4abf-9638-72ef80fa8531,
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531>
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:     incominguser gp4Czxr3Q4bnWEQuDCm5 9oXxXnfb5fAYaMtZ
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:44:10.533434 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:44:10.535063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:10.800857 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:10.901697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.366s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:10.902055 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:10.903291 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:44:10.903700 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:44:10.905204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:10.912115 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:10.912884 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n            Backing store flags: \n    Account information:\n        gp4Czxr3Q4bnWEQuDCm5\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:44:10.913566 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:44:10.916792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:10.999097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:10.999485 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n            Backing store flags: \n    Account information:\n        gp4Czxr3Q4bnWEQuDCm5\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:11.001000 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:11.079460 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:11.079867 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n            Backing store flags: \n    Account information:\n        gp4Czxr3Q4bnWEQuDCm5\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:11.081005 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:44:11.343261 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-d77dcb60-c971-4f67-978e-75ad593d5d14 req-e1e42c86-dde3-44e5-b1db-dd9c60cea6f6 tempest-VolumesSnapshotTestJSON-954851200 None] attachment_update completed successfully.
Jan 25 13:44:11.806966 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:12.812498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:13.818699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:14.824254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:15.829443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:16.835749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:17.840957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:18.143653 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-77dd0703-4306-4064-83ef-66bd13d31cd4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:18.160616 n-d-760454-3 sudo[9840]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:18.161162 n-d-760454-3 sudo[9840]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:18.670340 n-d-760454-3 sudo[9840]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:18.672757 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-77dd0703-4306-4064-83ef-66bd13d31cd4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.529s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:18.673943 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-77dd0703-4306-4064-83ef-66bd13d31cd4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:18.690539 n-d-760454-3 sudo[9844]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g
Jan 25 13:44:18.691148 n-d-760454-3 sudo[9844]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:18.848795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:19.440510 n-d-760454-3 sudo[9844]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:19.442419 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-77dd0703-4306-4064-83ef-66bd13d31cd4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g" returned: 0 in 0.768s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:19.646154 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-77dd0703-4306-4064-83ef-66bd13d31cd4 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:44:19.854354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:20.576358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09b42e36-c2d8-407d-b088-8aed24b767f8 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:20.593501 n-d-760454-3 sudo[9941]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:20.594135 n-d-760454-3 sudo[9941]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:20.862692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:21.072870 n-d-760454-3 sudo[9941]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:21.075932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09b42e36-c2d8-407d-b088-8aed24b767f8 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.499s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:21.076822 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09b42e36-c2d8-407d-b088-8aed24b767f8 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:21.094472 n-d-760454-3 sudo[9945]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g
Jan 25 13:44:21.095106 n-d-760454-3 sudo[9945]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:21.870288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:21.958906 n-d-760454-3 sudo[9945]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:21.960910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09b42e36-c2d8-407d-b088-8aed24b767f8 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g" returned: 0 in 0.884s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:22.105481 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-09b42e36-c2d8-407d-b088-8aed24b767f8 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:44:22.883098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:23.072978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-82ab6dc1-fd0d-4b48-9a0a-c5b78b9ae620 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:23.090122 n-d-760454-3 sudo[10050]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:23.091175 n-d-760454-3 sudo[10050]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:23.581467 n-d-760454-3 sudo[10050]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:23.583853 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-82ab6dc1-fd0d-4b48-9a0a-c5b78b9ae620 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.511s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:23.585010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-82ab6dc1-fd0d-4b48-9a0a-c5b78b9ae620 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:23.601498 n-d-760454-3 sudo[10054]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g
Jan 25 13:44:23.602088 n-d-760454-3 sudo[10054]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:23.891181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:24.435445 n-d-760454-3 sudo[10054]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:24.437351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-82ab6dc1-fd0d-4b48-9a0a-c5b78b9ae620 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36 --snapshot stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -L 1.00g" returned: 0 in 0.852s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:24.600696 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-82ab6dc1-fd0d-4b48-9a0a-c5b78b9ae620 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:44:24.896563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:25.248056 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-8e5c3fa4-a004-4bb0-a381-4ace44c8214c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:44:25.249979 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:25.304376 n-d-760454-3 sudo[10178]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c
Jan 25 13:44:25.305000 n-d-760454-3 sudo[10178]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:25.909042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:25.944466 n-d-760454-3 sudo[10178]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:25.946980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c" returned: 0 in 0.697s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:25.948892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:25.969222 n-d-760454-3 sudo[10182]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c
Jan 25 13:44:25.969961 n-d-760454-3 sudo[10182]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:26.580168 n-d-760454-3 sudo[10182]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:26.582500 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-8e5c3fa4-a004-4bb0-a381-4ace44c8214c" returned: 0 in 0.633s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:26.701319 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['cd9091c0-817e-43c2-8aeb-e3e93af13116', 'cac1683c-c2d4-4794-8013-6bddd7868916', 'f18d1579-2b09-4342-a3f2-3d7dfaa21221', '2a3200a0-05c1-4643-8d12-8f529cd49045'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:44:26.703274 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:44:26.703274 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:44:26.703274 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:44:26.859728 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:44:26.867987 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-dc3b85f3-aaff-43d9-8b8e-42cb63351f1f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-8e5c3fa4-a004-4bb0-a381-4ace44c8214c-delete_snapshot'" released by "delete_snapshot" :: held 1.620s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:44:26.921958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:27.532062 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-e4f33331-a0a5-4445-8406-a88bba3e9d36-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:44:27.534003 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:27.553104 n-d-760454-3 sudo[10274]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36
Jan 25 13:44:27.553647 n-d-760454-3 sudo[10274]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:27.930175 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:28.022851 n-d-760454-3 sudo[10274]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:28.024781 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36" returned: 0 in 0.491s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:28.026617 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:28.042876 n-d-760454-3 sudo[10278]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36
Jan 25 13:44:28.043486 n-d-760454-3 sudo[10278]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:28.641755 n-d-760454-3 sudo[10278]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:28.644792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-e4f33331-a0a5-4445-8406-a88bba3e9d36" returned: 0 in 0.617s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:28.768604 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['4153fc40-c253-4d0a-9720-e09a65980475', '909e2bbd-ae9c-4b52-8594-c71394508bf3', 'b9d6445a-9bdd-4b75-8c8f-8dfa733213e0', '005f1b8e-49f3-4f0e-9fb0-ea0e19d36104'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:44:28.770531 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:44:28.770531 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:44:28.770531 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:44:28.894552 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:44:28.900585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9a693209-06d2-46e7-a7f0-406bc4b5b73d tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-e4f33331-a0a5-4445-8406-a88bba3e9d36-delete_snapshot'" released by "delete_snapshot" :: held 1.369s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:44:28.935673 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:29.807024 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-c3af4d4f-318e-4ec6-be2a-0ecef604db47-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:44:29.809481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:29.844648 n-d-760454-3 sudo[10339]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47
Jan 25 13:44:29.845200 n-d-760454-3 sudo[10339]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:29.947446 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:30.419150 n-d-760454-3 sudo[10339]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:30.421989 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47" returned: 0 in 0.612s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:30.423557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:30.441299 n-d-760454-3 sudo[10343]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47
Jan 25 13:44:30.441888 n-d-760454-3 sudo[10343]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:30.962234 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:31.173684 n-d-760454-3 sudo[10343]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:31.175579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c3af4d4f-318e-4ec6-be2a-0ecef604db47" returned: 0 in 0.752s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:31.299703 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['8670b23b-fd84-43f1-a6c0-78c37ea025d0', 'c8a63f21-353d-49aa-b028-304f6fe3b209', '6505dccd-abdc-41d5-988f-a00db83dc816', 'be945d37-485a-4542-8140-f0939bdec29a'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:44:31.301796 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:44:31.301796 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:44:31.301796 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:44:31.452384 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:44:31.457545 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-875a842d-1b7d-4463-928f-232ac79edae5 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-c3af4d4f-318e-4ec6-be2a-0ecef604db47-delete_snapshot'" released by "delete_snapshot" :: held 1.651s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:44:31.961735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:32.967728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:33.074918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-44521968-c58d-46f5-bf4c-d3b4e4b1b9f1 req-831e2532-a5bc-4332-ac7b-fabd047969f0 tempest-VolumesSnapshotTestJSON-954851200 None] Terminate volume connection completed successfully.
Jan 25 13:44:33.075385 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-44521968-c58d-46f5-bf4c-d3b4e4b1b9f1 req-831e2532-a5bc-4332-ac7b-fabd047969f0 tempest-VolumesSnapshotTestJSON-954851200 None] Deleting attachment cedcd48d-fb5f-423d-bed2-a1eed52807aa. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:44:33.077171 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:33.155414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:33.155572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531\n            Backing store flags: \n    Account information:\n        gp4Czxr3Q4bnWEQuDCm5\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:33.156303 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-44521968-c58d-46f5-bf4c-d3b4e4b1b9f1 req-831e2532-a5bc-4332-ac7b-fabd047969f0 tempest-VolumesSnapshotTestJSON-954851200 None] Removing iscsi_target for Volume ID: b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:44:33.157495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:33.241861 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-b9761505-e4d6-4abf-9638-72ef80fa8531 -f" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:33.242276 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:33.243712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:33.321557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:33.321988 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:44:33.424797 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-44521968-c58d-46f5-bf4c-d3b4e4b1b9f1 req-831e2532-a5bc-4332-ac7b-fabd047969f0 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:44:33.424797 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:44:33.424797 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:44:33.973177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:34.979867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:35.986442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:36.993414 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:37.999077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:39.011298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:40.037010 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d252b8e8-6b64-4198-a365-b8775f94ce40 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:40.048832 n-d-760454-3 sudo[10430]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:44:40.053017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:40.049348 n-d-760454-3 sudo[10430]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:40.540726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d252b8e8-6b64-4198-a365-b8775f94ce40 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:40.540726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d252b8e8-6b64-4198-a365-b8775f94ce40 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-f31181a5-b267-4649-a1d1-5edacff2122f --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:40.536590 n-d-760454-3 sudo[10430]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:40.559540 n-d-760454-3 sudo[10434]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-f31181a5-b267-4649-a1d1-5edacff2122f --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g
Jan 25 13:44:40.560237 n-d-760454-3 sudo[10434]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:41.063453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:41.746385 n-d-760454-3 sudo[10434]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:41.749450 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-d252b8e8-6b64-4198-a365-b8775f94ce40 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-f31181a5-b267-4649-a1d1-5edacff2122f --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g" returned: 0 in 1.209s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:41.891838 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-d252b8e8-6b64-4198-a365-b8775f94ce40 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:44:42.061535 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:42.277394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-f31181a5-b267-4649-a1d1-5edacff2122f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:44:42.346106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:42.362700 n-d-760454-3 sudo[10542]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f
Jan 25 13:44:42.363311 n-d-760454-3 sudo[10542]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:42.878537 n-d-760454-3 sudo[10542]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:42.880917 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f" returned: 0 in 0.534s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:42.883145 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:42.902555 n-d-760454-3 sudo[10546]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f
Jan 25 13:44:42.903238 n-d-760454-3 sudo[10546]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:43.070789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:43.678441 n-d-760454-3 sudo[10546]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:43.680282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-f31181a5-b267-4649-a1d1-5edacff2122f" returned: 0 in 0.797s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:43.806840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['430e710e-528b-48ef-af59-5cfc5b02f5b9', 'f46c2faa-c38b-4cf4-a2eb-5c1e98b1ea94', '9bae9a95-7441-4964-b00b-e8a884ef90f8', '168e0d0b-d3f2-4508-8309-a16aec31c8a8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:44:43.809246 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:44:43.809246 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:44:43.809246 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:44:44.023502 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:44:44.029018 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-4c2cc5f1-f3ab-48b8-b0dc-afff903d7230 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-f31181a5-b267-4649-a1d1-5edacff2122f-delete_snapshot'" released by "delete_snapshot" :: held 1.752s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:44:44.079884 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:44.957886 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c98df9f-0b11-4ed2-8c58-b18dfdcc0a4f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:44.976855 n-d-760454-3 sudo[10617]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:44:44.977518 n-d-760454-3 sudo[10617]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:45.087938 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:45.797350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c98df9f-0b11-4ed2-8c58-b18dfdcc0a4f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.822s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:45.797350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c98df9f-0b11-4ed2-8c58-b18dfdcc0a4f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:45.776948 n-d-760454-3 sudo[10617]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:45.798801 n-d-760454-3 sudo[10621]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g
Jan 25 13:44:45.799431 n-d-760454-3 sudo[10621]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:46.099288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:47.040516 n-d-760454-3 sudo[10621]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:47.042707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6c98df9f-0b11-4ed2-8c58-b18dfdcc0a4f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g" returned: 0 in 1.262s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:47.104240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:47.168355 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6c98df9f-0b11-4ed2-8c58-b18dfdcc0a4f tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:44:47.172693 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:44:47.172693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:44:47.173457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:47.192819 n-d-760454-3 sudo[10746]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:44:47.193424 n-d-760454-3 sudo[10746]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:47.559573 n-d-760454-3 sudo[10746]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:47.561780 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:47.564398 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:44:47.583271 n-d-760454-3 sudo[10758]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:44:47.584085 n-d-760454-3 sudo[10758]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:44:48.110699 n-d-760454-3 sudo[10758]: pam_unix(sudo:session): session closed for user root
Jan 25 13:44:48.114580 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:44:48.116037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:44:48.121158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:49.135380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:50.138116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:51.143420 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:52.148902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:53.154750 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:54.161248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:55.175246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:56.181285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:57.187521 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:58.193046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:44:59.198449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:00.205780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:01.212693 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:02.219172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:03.224190 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:04.236053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:05.241067 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:06.248330 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:07.257959 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:07.367482 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:07.391569 n-d-760454-3 sudo[10941]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:45:07.392525 n-d-760454-3 sudo[10941]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:07.801105 n-d-760454-3 sudo[10941]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:07.803566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.437s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:07.861964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:07.866826 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:07.867153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:45:07.867818 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:45:07.870422 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Creating iscsi_target for Volume ID: volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Created volume path /opt/stack/data/cinder/volumes/volume-d7a6347d-1f38-407a-8948-a144b22f09f6,
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6>
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:     incominguser UiPxoJ3PRAyoe3QTuRjB CWi2hiJbiPov4QcR
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:45:07.973325 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:45:07.979721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:08.264792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:08.365871 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.391s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:08.366252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:08.366908 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:45:08.367301 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:45:08.368856 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:08.374534 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:08.374929 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n            Backing store flags: \n    Account information:\n        UiPxoJ3PRAyoe3QTuRjB\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:45:08.375598 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:45:08.377935 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:08.457161 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:08.457566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n            Backing store flags: \n    Account information:\n        UiPxoJ3PRAyoe3QTuRjB\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:08.459529 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:08.545538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.086s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:08.545937 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n            Backing store flags: \n    Account information:\n        UiPxoJ3PRAyoe3QTuRjB\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:08.547023 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:45:08.845926 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-39c68db8-e95d-4ab5-9b50-3f2999a74584 req-03fc3b0e-b963-410a-86ac-ef733e3b627a tempest-VolumesSnapshotTestJSON-954851200 None] attachment_update completed successfully.
Jan 25 13:45:09.270806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:10.278218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:11.286351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:12.292062 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:13.297591 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:14.303041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:15.309025 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:15.434950 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a78fcc81-427d-42b4-88f5-2ad6ab8c8ca9 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:15.451670 n-d-760454-3 sudo[11111]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:45:15.452310 n-d-760454-3 sudo[11111]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:15.930474 n-d-760454-3 sudo[11111]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:15.932981 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a78fcc81-427d-42b4-88f5-2ad6ab8c8ca9 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.498s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:15.934689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a78fcc81-427d-42b4-88f5-2ad6ab8c8ca9 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:15.950488 n-d-760454-3 sudo[11116]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g
Jan 25 13:45:15.951065 n-d-760454-3 sudo[11116]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:16.316266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:16.758513 n-d-760454-3 sudo[11116]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:16.760505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-a78fcc81-427d-42b4-88f5-2ad6ab8c8ca9 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g" returned: 0 in 0.826s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:16.863380 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-a78fcc81-427d-42b4-88f5-2ad6ab8c8ca9 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:45:17.323016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:17.810201 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78e39d78-0a82-4f0f-8a7f-f5c38bb44a4e tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:17.827704 n-d-760454-3 sudo[11242]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:45:17.828279 n-d-760454-3 sudo[11242]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:18.293986 n-d-760454-3 sudo[11242]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:18.296291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78e39d78-0a82-4f0f-8a7f-f5c38bb44a4e tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.486s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:18.297481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78e39d78-0a82-4f0f-8a7f-f5c38bb44a4e tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:18.313850 n-d-760454-3 sudo[11246]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g
Jan 25 13:45:18.314484 n-d-760454-3 sudo[11246]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:18.331832 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:19.139320 n-d-760454-3 sudo[11246]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:19.141245 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-78e39d78-0a82-4f0f-8a7f-f5c38bb44a4e tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92 --snapshot stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -L 1.00g" returned: 0 in 0.844s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:19.225566 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-78e39d78-0a82-4f0f-8a7f-f5c38bb44a4e tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:45:19.337072 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:19.947430 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-ebb6f3b2-a40b-4562-bd03-c9d49519da92-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:45:19.950219 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:19.976817 n-d-760454-3 sudo[11391]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92
Jan 25 13:45:19.977367 n-d-760454-3 sudo[11391]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:20.348993 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:20.473236 n-d-760454-3 sudo[11391]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:20.475116 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92" returned: 0 in 0.526s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:20.476972 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:20.493933 n-d-760454-3 sudo[11395]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92
Jan 25 13:45:20.494466 n-d-760454-3 sudo[11395]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:21.177647 n-d-760454-3 sudo[11395]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:21.179862 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-ebb6f3b2-a40b-4562-bd03-c9d49519da92" returned: 0 in 0.702s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:21.320580 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['9520f4b5-7f6a-4c87-a198-d484b23983bb', '6403a5cc-4e20-492c-b000-738aa7d4c21b', '38fba59f-c853-4cd6-bc73-d49a7ed2a578', '7c88f901-80d7-47e4-9235-177d40467b0c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:45:21.322454 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:45:21.322454 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:45:21.322454 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:45:21.358271 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:21.415049 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:45:21.420569 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-ffa73505-9069-4a74-8ae6-282ecd58d8a1 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-ebb6f3b2-a40b-4562-bd03-c9d49519da92-delete_snapshot'" released by "delete_snapshot" :: held 1.473s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:45:22.233866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-c5ac3d57-588a-4fd1-afa8-4b414db8e320-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:45:22.236008 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:22.264492 n-d-760454-3 sudo[11490]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320
Jan 25 13:45:22.265185 n-d-760454-3 sudo[11490]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:22.369070 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:22.953719 n-d-760454-3 sudo[11490]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:22.955708 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320" returned: 0 in 0.720s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:22.957538 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:22.974087 n-d-760454-3 sudo[11494]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320
Jan 25 13:45:22.974739 n-d-760454-3 sudo[11494]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:23.382248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:23.881010 n-d-760454-3 sudo[11494]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:23.883819 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ac3d57-588a-4fd1-afa8-4b414db8e320" returned: 0 in 0.926s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:24.020198 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['e23b5851-3855-409f-8491-1561abcd54d3', '706fb848-013b-40ca-9ecc-209e6ba61196', 'a07347d4-5ba1-4cf1-abe2-239e768c0d9c', '662485d9-2cd3-4422-b678-89947a37c941'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:45:24.022405 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:45:24.022405 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:45:24.022405 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:45:24.120668 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:45:24.126585 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-417351ea-96d6-483b-9215-4ae3d685813f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-c5ac3d57-588a-4fd1-afa8-4b414db8e320-delete_snapshot'" released by "delete_snapshot" :: held 1.893s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:45:24.389806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:24.528088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-61a5a212-b39c-492d-87b1-7b4d52b85475-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:45:24.530179 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:24.550021 n-d-760454-3 sudo[11572]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475
Jan 25 13:45:24.554600 n-d-760454-3 sudo[11572]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:25.060079 n-d-760454-3 sudo[11572]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:25.062641 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475" returned: 0 in 0.532s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:25.064864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:25.081101 n-d-760454-3 sudo[11588]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475
Jan 25 13:45:25.081773 n-d-760454-3 sudo[11588]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:25.399932 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:26.409458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:26.720859 n-d-760454-3 sudo[11588]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:26.723278 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-61a5a212-b39c-492d-87b1-7b4d52b85475" returned: 0 in 1.658s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:26.846457 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['c3dfda33-fab5-435a-9e5a-04572e9afc5f', '28fa5845-d515-4849-9fa5-a57edaae7370', '3109cd62-ab93-41e1-b3a8-f07876ad7be8', '580303ed-9cfe-476c-a60c-395f29f5e37d'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:45:26.848398 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:45:26.848398 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:45:26.848398 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:45:26.995267 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:45:27.000317 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-3764d33e-76d3-4385-8c6e-50bd3efe14c6 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-61a5a212-b39c-492d-87b1-7b4d52b85475-delete_snapshot'" released by "delete_snapshot" :: held 2.472s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:45:27.414866 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:28.420972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:28.996698 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-c43b327e-89a8-416b-83ec-11876f0025b0 req-a1700b11-c33c-43fe-8983-7af8c21b3ab9 tempest-VolumesSnapshotTestJSON-954851200 None] Terminate volume connection completed successfully.
Jan 25 13:45:28.997139 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-c43b327e-89a8-416b-83ec-11876f0025b0 req-a1700b11-c33c-43fe-8983-7af8c21b3ab9 tempest-VolumesSnapshotTestJSON-954851200 None] Deleting attachment 3df4f56c-0992-46ac-ad5d-e9aadc42da3f. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:45:28.999551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:29.094892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.093s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:29.094892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6\n            Backing store flags: \n    Account information:\n        UiPxoJ3PRAyoe3QTuRjB\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:29.095125 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-c43b327e-89a8-416b-83ec-11876f0025b0 req-a1700b11-c33c-43fe-8983-7af8c21b3ab9 tempest-VolumesSnapshotTestJSON-954851200 None] Removing iscsi_target for Volume ID: d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:45:29.096283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:29.188733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-d7a6347d-1f38-407a-8948-a144b22f09f6 -f" returned: 0 in 0.091s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:29.189074 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:29.190542 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:29.274236 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.083s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:29.276342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:45:29.396335 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-c43b327e-89a8-416b-83ec-11876f0025b0 req-a1700b11-c33c-43fe-8983-7af8c21b3ab9 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:45:29.396335 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:45:29.396335 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:45:29.427879 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:30.433366 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:31.440269 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:32.445453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:33.451370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:34.457754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:35.463539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:35.850326 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:45:35.855857 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:45:35.855857 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:45:35.868938 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (ba01c807-5620-4e76-94dd-f8d87ad27a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:45:35.875579 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0f9c68-5a96-47d4-82ab-b675d2bef961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:35.897938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:45:35.925661 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0f9c68-5a96-47d4-82ab-b675d2bef961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1981035712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=5bcfce8d-898a-4dff-b0ba-fc3951344631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:45:36Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:35.928667 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34fb600-6f4d-4ae3-824d-2935fc620aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:35.930952 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34fb600-6f4d-4ae3-824d-2935fc620aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:35.933817 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c87fc3-aeaf-441f-a774-f5b633495cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:35.935847 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c87fc3-aeaf-441f-a774-f5b633495cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcfce8d-898a-4dff-b0ba-fc3951344631', 'volume_name': 'volume-5bcfce8d-898a-4dff-b0ba-fc3951344631', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:35.938394 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e523bac4-9c12-4661-bee6-76071e07a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:35.941189 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e523bac4-9c12-4661-bee6-76071e07a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:35.943450 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad51a8d6-49d4-4d58-8cda-9a075554abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:35.944386 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Volume 5bcfce8d-898a-4dff-b0ba-fc3951344631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcfce8d-898a-4dff-b0ba-fc3951344631', 'volume_size': 1}
Jan 25 13:45:35.945681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:35.961880 n-d-760454-3 sudo[11674]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:45:35.962418 n-d-760454-3 sudo[11674]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:36.472032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:36.618074 n-d-760454-3 sudo[11674]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:36.620250 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.674s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:36.623310 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad51a8d6-49d4-4d58-8cda-9a075554abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcfce8d-898a-4dff-b0ba-fc3951344631', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:36.625824 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1ba845-104c-4977-9abb-68069687a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:36.680633 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 (5bcfce8d-898a-4dff-b0ba-fc3951344631): created successfully
Jan 25 13:45:36.682718 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1ba845-104c-4977-9abb-68069687a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:36.685989 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (ba01c807-5620-4e76-94dd-f8d87ad27a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:45:36.740604 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b103f468-0dbd-4c4a-a0ba-9a27b7307182 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:45:37.416794 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09280289-8244-4e30-8b50-00ae3dabcfc9 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:37.433513 n-d-760454-3 sudo[11709]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:45:37.434137 n-d-760454-3 sudo[11709]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:37.479660 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:37.946249 n-d-760454-3 sudo[11709]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:37.948131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09280289-8244-4e30-8b50-00ae3dabcfc9 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631" returned: 0 in 0.531s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:37.949347 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09280289-8244-4e30-8b50-00ae3dabcfc9 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 --snapshot stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:37.966356 n-d-760454-3 sudo[11713]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 --snapshot stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 -L 1.00g
Jan 25 13:45:37.966937 n-d-760454-3 sudo[11713]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:38.486417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:38.962136 n-d-760454-3 sudo[11713]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:38.964130 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-09280289-8244-4e30-8b50-00ae3dabcfc9 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 --snapshot stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 -L 1.00g" returned: 0 in 1.015s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:39.059953 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-09280289-8244-4e30-8b50-00ae3dabcfc9 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:45:39.492335 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:40.302494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:45:40.306788 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:45:40.307442 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:45:40.331855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (e097ad70-8991-4210-805e-3450fb471971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:45:40.335258 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9834a4c8-c438-47f7-82a8-035f1c013ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:40.358027 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:45:40.385205 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9834a4c8-c438-47f7-82a8-035f1c013ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083850917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=cad896d8-c394-4cc1-b07b-117fd765916c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:45:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:45:40Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:40.388068 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f3fcac-2660-457b-8f98-028d82c8e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:40.390618 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f3fcac-2660-457b-8f98-028d82c8e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:40.393111 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0104fb74-e10e-4791-a493-25e0d11a6bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:40.395802 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0104fb74-e10e-4791-a493-25e0d11a6bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cad896d8-c394-4cc1-b07b-117fd765916c', 'volume_name': 'volume-cad896d8-c394-4cc1-b07b-117fd765916c', 'volume_size': 2, 'snapshot_id': '0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:40.398536 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e94c1-8be7-447c-b25b-2c805334c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:40.399894 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006e94c1-8be7-447c-b25b-2c805334c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:45:40.402180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81007661-83b4-422a-99db-2094050ec754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:45:40.403033 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Volume cad896d8-c394-4cc1-b07b-117fd765916c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cad896d8-c394-4cc1-b07b-117fd765916c', 'volume_size': 2, 'snapshot_id': '0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4'}
Jan 25 13:45:40.430992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cad896d8-c394-4cc1-b07b-117fd765916c stack-volumes-lvmdriver-1 -L 2g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:40.448192 n-d-760454-3 sudo[11815]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cad896d8-c394-4cc1-b07b-117fd765916c stack-volumes-lvmdriver-1 -L 2g
Jan 25 13:45:40.448769 n-d-760454-3 sudo[11815]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:40.500271 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:41.097002 n-d-760454-3 sudo[11815]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:41.098909 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-cad896d8-c394-4cc1-b07b-117fd765916c stack-volumes-lvmdriver-1 -L 2g" returned: 0 in 0.668s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:41.100736 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:41.118211 n-d-760454-3 sudo[11846]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4
Jan 25 13:45:41.118762 n-d-760454-3 sudo[11846]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:41.491228 n-d-760454-3 sudo[11846]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:41.493566 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4" returned: 0 in 0.392s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:41.496404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:41.513841 n-d-760454-3 sudo[11850]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c iflag=direct
Jan 25 13:45:41.514537 n-d-760454-3 sudo[11850]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:41.518626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:41.867178 n-d-760454-3 sudo[11850]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:41.869096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c iflag=direct" returned: 0 in 0.373s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:41.870273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:41.889033 n-d-760454-3 sudo[11860]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c oflag=direct
Jan 25 13:45:41.889552 n-d-760454-3 sudo[11860]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:42.239009 n-d-760454-3 sudo[11860]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:42.241484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c oflag=direct" returned: 0 in 0.371s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:42.244831 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:42.259345 n-d-760454-3 sudo[11867]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:45:42.259888 n-d-760454-3 sudo[11867]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:42.527063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:43.532032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:44.537605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:45.543565 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:46.549495 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:47.176279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:45:47.176835 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:45:47.178174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:47.194851 n-d-760454-3 sudo[11878]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:45:47.195644 n-d-760454-3 sudo[11878]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:47.550194 n-d-760454-3 sudo[11878]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:47.554576 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.377s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:47.555635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:45:47.571693 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:47.571989 n-d-760454-3 sudo[11882]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:45:47.572578 n-d-760454-3 sudo[11882]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:45:48.394389 n-d-760454-3 sudo[11882]: pam_unix(sudo:session): session closed for user root
Jan 25 13:45:48.396696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.840s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:45:48.398562 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:45:48.577717 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:49.583924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:50.589840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:51.595387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:52.603742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:53.610475 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:54.616430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:55.622232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:56.628140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:57.634814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:58.640177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:45:59.645645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:00.651279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:01.657675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:02.401332 n-d-760454-3 sudo[11867]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:02.403433 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 20.161s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:02.404041 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0aedefc5--9d3e--45cf--9ec1--0ee2820c82a4, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--cad896d8--c394--4cc1--b07b--117fd765916c, size 1024.00 MB, duration 20.16 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:46:02.404454 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy 1024.00 MB at 50.79 MB/s
Jan 25 13:46:02.456095 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81007661-83b4-422a-99db-2094050ec754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad896d8-c394-4cc1-b07b-117fd765916c', 'volume_size': 2, 'snapshot_id': '0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:02.458527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbea058-824c-4341-9c38-61ead0f7c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:02.506128 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-cad896d8-c394-4cc1-b07b-117fd765916c (cad896d8-c394-4cc1-b07b-117fd765916c): created successfully
Jan 25 13:46:02.508117 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbea058-824c-4341-9c38-61ead0f7c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:02.511471 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (e097ad70-8991-4210-805e-3450fb471971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:46:02.560492 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-6f00e660-aff1-430d-a3ba-2cca8c3adc03 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:46:02.662769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:03.667211 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-cad896d8-c394-4cc1-b07b-117fd765916c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:03.701748 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:03.802349 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: cad896d8-c394-4cc1-b07b-117fd765916c
Jan 25 13:46:03.803212 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:03.820843 n-d-760454-3 sudo[11903]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c
Jan 25 13:46:03.821400 n-d-760454-3 sudo[11903]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:04.498523 n-d-760454-3 sudo[11903]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:04.501665 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c" returned: 0 in 0.698s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:04.502860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:04.519997 n-d-760454-3 sudo[11907]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c
Jan 25 13:46:04.520598 n-d-760454-3 sudo[11907]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:04.712339 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:04.895211 n-d-760454-3 sudo[11907]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:04.897160 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c" returned: 0 in 0.394s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:04.899046 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:04.917489 n-d-760454-3 sudo[11911]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c
Jan 25 13:46:04.918196 n-d-760454-3 sudo[11911]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:05.572891 n-d-760454-3 sudo[11911]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:05.575016 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-cad896d8-c394-4cc1-b07b-117fd765916c" returned: 0 in 0.676s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:05.576123 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: cad896d8-c394-4cc1-b07b-117fd765916c
Jan 25 13:46:05.700419 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['2e16e7f8-9d02-4f90-be2d-e690839b3162', '9c4aab05-a3ff-4976-acef-aa074725d316', '3d1921c0-4522-40f5-a777-d800f476b8aa', '34ce9558-7884-40a4-ac6d-aebbb0af56e6'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:05.700419 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:05.700419 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:05.700419 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:05.723615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:05.837880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:05.837880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:05.849987 n-d-760454-3 sudo[11920]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:05.850573 n-d-760454-3 sudo[11920]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:06.222287 n-d-760454-3 sudo[11920]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:06.224625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.392s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:06.226763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:06.245295 n-d-760454-3 sudo[11924]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:06.245842 n-d-760454-3 sudo[11924]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:06.735038 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:06.832479 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:46:06.837448 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:46:06.847933 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:46:06.852930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (438c976e-3c39-4e17-98d7-c340da7ca47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:46:06.856844 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18e4ce1-bba8-47c2-a6b0-8a5517b28c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:06.873871 n-d-760454-3 sudo[11924]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:06.880113 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:06.881844 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:06.904245 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:46:06.904245 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:06.942007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18e4ce1-bba8-47c2-a6b0-8a5517b28c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509132964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=3fc985fc-8db4-4361-bc0c-8f407b3f5adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:46:07Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:06.942007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74adb986-68bb-4c7c-8768-df939d65ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:06.942007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74adb986-68bb-4c7c-8768-df939d65ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:06.942007 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44311ef-690e-4e52-afb8-7e18140501db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:06.944042 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44311ef-690e-4e52-afb8-7e18140501db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc985fc-8db4-4361-bc0c-8f407b3f5adc', 'volume_name': 'volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:06.946484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b79ddf-e66e-40ec-9628-47752a744146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:06.948797 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b79ddf-e66e-40ec-9628-47752a744146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:06.951163 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9583dc5-943e-422c-810b-124ab29781a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:06.952008 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Volume 3fc985fc-8db4-4361-bc0c-8f407b3f5adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc', 'volume_size': 1}
Jan 25 13:46:06.953200 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:06.971260 n-d-760454-3 sudo[11930]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:46:06.971836 n-d-760454-3 sudo[11930]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:07.033383 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-58628f90-a8ba-4d33-85cc-c175879c497c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-cad896d8-c394-4cc1-b07b-117fd765916c-delete_volume'" released by "delete_volume" :: held 3.366s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:07.664274 n-d-760454-3 sudo[11930]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:07.666443 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.713s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:07.669598 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9583dc5-943e-422c-810b-124ab29781a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:07.675178 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424ceb89-b5a3-4954-b57f-8a4be5b2f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:07.741655 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc (3fc985fc-8db4-4361-bc0c-8f407b3f5adc): created successfully
Jan 25 13:46:07.744269 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424ceb89-b5a3-4954-b57f-8a4be5b2f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:07.747484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (438c976e-3c39-4e17-98d7-c340da7ca47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:46:07.753230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:07.783118 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-733d8671-78c3-4cb3-9987-66711f73ddb7 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:46:08.227615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7783484-725f-4417-8381-555557493ee1 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:08.244006 n-d-760454-3 sudo[11961]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:08.244601 n-d-760454-3 sudo[11961]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:08.730442 n-d-760454-3 sudo[11961]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:08.732905 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7783484-725f-4417-8381-555557493ee1 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc" returned: 0 in 0.505s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:08.734630 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7783484-725f-4417-8381-555557493ee1 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 --snapshot stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:08.758515 n-d-760454-3 sudo[11965]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 --snapshot stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc -L 1.00g
Jan 25 13:46:08.759455 n-d-760454-3 sudo[11965]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:08.766522 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:09.603283 n-d-760454-3 sudo[11965]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:09.605186 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b7783484-725f-4417-8381-555557493ee1 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 --snapshot stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc -L 1.00g" returned: 0 in 0.871s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:09.697791 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b7783484-725f-4417-8381-555557493ee1 tempest-VolumesSnapshotTestJSON-954851200 None] Create snapshot completed successfully
Jan 25 13:46:09.772589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:10.779761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:11.140850 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:46:11.145476 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:46:11.146018 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:46:11.170649 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (a5fd5ed2-e21b-430d-8c13-6b2aea183a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:46:11.174035 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e838361-e779-4300-a8a5-4679f6394ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:11.197081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:46:11.225243 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e838361-e779-4300-a8a5-4679f6394ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1929791596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=aeb3bbe5-678d-413e-baa2-7eae56e0ddf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9839874c19435e93b426127f292e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0460ec61-8697-49ef-a70f-4b4b410eac77,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:46:11Z,user_id='ae3b578a2d074b598c9209fb96102995',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:11.228096 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ae7572-0f4c-4da3-bbd5-ade77496b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:11.230396 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ae7572-0f4c-4da3-bbd5-ade77496b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:11.233521 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf22696-061e-4fd4-831b-aff5fd8da1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:11.235702 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf22696-061e-4fd4-831b-aff5fd8da1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aeb3bbe5-678d-413e-baa2-7eae56e0ddf9', 'volume_name': 'volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9', 'volume_size': 1, 'snapshot_id': '0460ec61-8697-49ef-a70f-4b4b410eac77'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:11.239353 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f4e05a-a83b-422b-9c46-2059d5b18333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:11.240487 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f4e05a-a83b-422b-9c46-2059d5b18333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:11.242839 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e0358c-507d-40bf-b840-d4bf1393d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:11.243680 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Volume aeb3bbe5-678d-413e-baa2-7eae56e0ddf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9', 'volume_size': 1, 'snapshot_id': '0460ec61-8697-49ef-a70f-4b4b410eac77'}
Jan 25 13:46:11.267194 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:11.284438 n-d-760454-3 sudo[12066]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:46:11.285010 n-d-760454-3 sudo[12066]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:11.791266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:11.951007 n-d-760454-3 sudo[12066]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:11.953563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.686s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:11.955434 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:11.981356 n-d-760454-3 sudo[12097]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77
Jan 25 13:46:11.981996 n-d-760454-3 sudo[12097]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:12.359499 n-d-760454-3 sudo[12097]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:12.361903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77" returned: 0 in 0.406s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:12.364387 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:12.381833 n-d-760454-3 sudo[12101]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 iflag=direct
Jan 25 13:46:12.382383 n-d-760454-3 sudo[12101]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:12.725237 n-d-760454-3 sudo[12101]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:12.727832 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 iflag=direct" returned: 0 in 0.363s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:12.729023 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:12.746228 n-d-760454-3 sudo[12111]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 oflag=direct
Jan 25 13:46:12.746847 n-d-760454-3 sudo[12111]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:12.805292 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:13.120160 n-d-760454-3 sudo[12111]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:13.122231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 oflag=direct" returned: 0 in 0.393s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:13.123338 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:13.139603 n-d-760454-3 sudo[12121]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:46:13.140758 n-d-760454-3 sudo[12121]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:13.816765 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:14.826455 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:15.835594 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:16.852839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:17.861802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:18.871370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:19.885800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:20.894643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:21.903669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:22.912796 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:23.930343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:24.932625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:25.946880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:26.957501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:27.966564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:28.984164 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:29.194299 n-d-760454-3 sudo[12121]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:29.196359 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 16.073s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:29.197023 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--0460ec61--8697--49ef--a70f--4b4b410eac77, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--aeb3bbe5--678d--413e--baa2--7eae56e0ddf9, size 1024.00 MB, duration 16.07 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:46:29.197481 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Volume copy 1024.00 MB at 63.70 MB/s
Jan 25 13:46:29.252723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e0358c-507d-40bf-b840-d4bf1393d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9', 'volume_size': 1, 'snapshot_id': '0460ec61-8697-49ef-a70f-4b4b410eac77'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:29.255148 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385f2ac5-3cf0-4f4d-968e-70103bec167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:46:29.320222 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Volume volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 (aeb3bbe5-678d-413e-baa2-7eae56e0ddf9): created successfully
Jan 25 13:46:29.322320 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385f2ac5-3cf0-4f4d-968e-70103bec167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:46:29.331927 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Flow 'volume_create_manager' (a5fd5ed2-e21b-430d-8c13-6b2aea183a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:46:29.483448 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-19f9fe16-6f38-4f10-8d12-5c770c784527 tempest-VolumesSnapshotTestJSON-954851200 None] Created volume successfully.
Jan 25 13:46:29.994833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:30.462965 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:30.578803 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: aeb3bbe5-678d-413e-baa2-7eae56e0ddf9
Jan 25 13:46:30.579673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:30.599768 n-d-760454-3 sudo[12160]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9
Jan 25 13:46:30.600276 n-d-760454-3 sudo[12160]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:30.998455 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:31.708524 n-d-760454-3 sudo[12160]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:31.710807 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9" returned: 0 in 1.131s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:31.711935 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:31.730667 n-d-760454-3 sudo[12164]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9
Jan 25 13:46:31.731234 n-d-760454-3 sudo[12164]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:32.009853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:32.103157 n-d-760454-3 sudo[12164]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:32.105690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9" returned: 0 in 0.394s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:32.108294 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:32.125514 n-d-760454-3 sudo[12168]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9
Jan 25 13:46:32.126084 n-d-760454-3 sudo[12168]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:32.869207 n-d-760454-3 sudo[12168]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:32.871521 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9" returned: 0 in 0.763s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:32.872934 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: aeb3bbe5-678d-413e-baa2-7eae56e0ddf9
Jan 25 13:46:32.960609 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['3cc7a6e9-1f80-4a11-9b66-fc73edc52330', '75163cd3-7fea-463a-9bae-675f79d7cf4d', '1273a315-4bba-47ed-a2ba-72e5227ed7b6', 'a04ba6a1-f725-4d92-93c5-5f35549c351c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:32.964875 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:32.964875 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:32.964875 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:33.019586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:33.166752 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:33.167386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:33.187976 n-d-760454-3 sudo[12177]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:33.188755 n-d-760454-3 sudo[12177]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:33.560383 n-d-760454-3 sudo[12177]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:33.564462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:33.566262 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:33.583336 n-d-760454-3 sudo[12181]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:33.583942 n-d-760454-3 sudo[12181]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:34.033942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:34.164723 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-0460ec61-8697-49ef-a70f-4b4b410eac77-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:34.232492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:34.184967 n-d-760454-3 sudo[12185]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77
Jan 25 13:46:34.185500 n-d-760454-3 sudo[12185]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:34.316678 n-d-760454-3 sudo[12181]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:34.324866 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:34.324866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:34.329014 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:34.420805 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-415d8d40-afb0-416b-b4ac-c683ec3be697 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-aeb3bbe5-678d-413e-baa2-7eae56e0ddf9-delete_volume'" released by "delete_volume" :: held 3.958s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:34.967142 n-d-760454-3 sudo[12185]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:34.969323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77" returned: 0 in 0.802s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:34.980936 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:34.988953 n-d-760454-3 sudo[12189]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77
Jan 25 13:46:34.990012 n-d-760454-3 sudo[12189]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:35.044042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:35.971183 n-d-760454-3 sudo[12189]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:35.973084 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0460ec61-8697-49ef-a70f-4b4b410eac77" returned: 0 in 1.002s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:36.053965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:36.111175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['8961252d-ebb2-4eeb-b57e-77705b8af20a', '9cc70325-d7c3-4781-9172-68ad21038f90', 'a063d5d4-1b7b-44f7-bb53-9552ff513132', '730745ad-e9a5-432c-bd3f-cd071346a4f2'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:36.113146 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:36.113146 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:36.113146 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:36.245575 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:46:36.250839 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-84f99a86-5571-4fb2-90bc-e76e0d413b3e tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-0460ec61-8697-49ef-a70f-4b4b410eac77-delete_snapshot'" released by "delete_snapshot" :: held 2.086s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:36.597030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-3fc985fc-8db4-4361-bc0c-8f407b3f5adc-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:36.710894 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: 3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:36.711821 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:36.731715 n-d-760454-3 sudo[12240]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:36.733082 n-d-760454-3 sudo[12240]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:37.064977 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:37.410056 n-d-760454-3 sudo[12240]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:37.424103 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc" returned: 0 in 0.700s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:37.424103 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:37.434722 n-d-760454-3 sudo[12256]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:37.435366 n-d-760454-3 sudo[12256]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:37.849888 n-d-760454-3 sudo[12256]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:37.852198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc" returned: 0 in 0.438s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:37.854346 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:37.877929 n-d-760454-3 sudo[12260]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:37.879466 n-d-760454-3 sudo[12260]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:38.073259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:38.629908 n-d-760454-3 sudo[12260]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:38.631761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-3fc985fc-8db4-4361-bc0c-8f407b3f5adc" returned: 0 in 0.777s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:38.632896 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: 3fc985fc-8db4-4361-bc0c-8f407b3f5adc
Jan 25 13:46:38.714314 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['171a4321-2404-4836-93e7-ef8d8e0aeeef', 'ac2813e7-e589-480f-91d1-83b28a7530c8', '305d6756-ed35-4113-8ed0-4ed80b6d3972', 'a58b7896-da99-40ea-8d9e-eb8b4295b754'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:38.716817 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:38.716817 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:38.716817 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:38.825946 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:38.826510 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:38.843963 n-d-760454-3 sudo[12269]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:38.844575 n-d-760454-3 sudo[12269]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:39.081645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:39.255372 n-d-760454-3 sudo[12269]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:39.259801 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:39.261558 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:39.281621 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:39.283766 n-d-760454-3 sudo[12273]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:39.284471 n-d-760454-3 sudo[12273]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:39.285091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:39.314415 n-d-760454-3 sudo[12275]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4
Jan 25 13:46:39.315024 n-d-760454-3 sudo[12275]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:39.842521 n-d-760454-3 sudo[12273]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:39.847596 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:39.850157 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:39.882116 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:39.906426 n-d-760454-3 sudo[12275]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:39.908632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4" returned: 0 in 0.624s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:39.910297 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:39.929754 n-d-760454-3 sudo[12281]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4
Jan 25 13:46:39.930424 n-d-760454-3 sudo[12281]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:39.948489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-28cf1145-bcac-4a78-a98b-93203a4764d4 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-3fc985fc-8db4-4361-bc0c-8f407b3f5adc-delete_volume'" released by "delete_volume" :: held 3.351s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:40.091925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:40.549192 n-d-760454-3 sudo[12281]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:40.551139 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4" returned: 0 in 0.641s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:40.677737 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['03785ea0-0e10-429b-b5d2-2153b9a4b1cb', 'ea4b64c8-1bba-4a35-9a4f-307fc2230805', '97f16d57-ceb5-4ffa-a5b4-df6e34b4cf81', 'b61d3891-655b-466e-8b54-85de6381842e'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:40.679548 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:40.679548 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:40.679548 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:40.820221 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:46:40.826553 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-cf4049e8-c549-43d5-a8fe-a605d8a3126c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-0aedefc5-9d3e-45cf-9ec1-0ee2820c82a4-delete_snapshot'" released by "delete_snapshot" :: held 1.546s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:41.098488 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:41.575742 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-5bcfce8d-898a-4dff-b0ba-fc3951344631-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:41.669430 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: 5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:46:41.670488 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:41.687873 n-d-760454-3 sudo[12323]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:46:41.688419 n-d-760454-3 sudo[12323]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:42.113387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:42.174752 n-d-760454-3 sudo[12323]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:42.176963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631" returned: 0 in 0.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:42.178041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:42.196938 n-d-760454-3 sudo[12327]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:46:42.197499 n-d-760454-3 sudo[12327]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:42.583603 n-d-760454-3 sudo[12327]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:42.585916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631" returned: 0 in 0.407s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:42.587920 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:42.604907 n-d-760454-3 sudo[12332]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:46:42.605485 n-d-760454-3 sudo[12332]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:43.108270 n-d-760454-3 sudo[12332]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:43.110685 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-5bcfce8d-898a-4dff-b0ba-fc3951344631" returned: 0 in 0.522s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:43.111965 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: 5bcfce8d-898a-4dff-b0ba-fc3951344631
Jan 25 13:46:43.141309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:43.220434 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['02416614-de40-4643-8ba1-5f6dc42e7ac5', 'a771982d-f413-4007-8ba8-360d7dc83bd1', 'a75609c0-2317-4e91-af6b-42b071aac3b9', '6c96404b-467e-4be5-9a54-8662ba3446ba'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:43.222825 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:43.222825 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:43.222825 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:43.317164 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:43.317962 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:43.335346 n-d-760454-3 sudo[12341]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:43.335916 n-d-760454-3 sudo[12341]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:43.692794 n-d-760454-3 sudo[12341]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:43.695147 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.377s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:43.701605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:43.713458 n-d-760454-3 sudo[12345]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:43.714110 n-d-760454-3 sudo[12345]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:44.153458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:44.197419 n-d-760454-3 sudo[12345]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:44.199849 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:44.201568 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:44.207652 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:44.249337 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-b9761505-e4d6-4abf-9638-72ef80fa8531-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:44.267469 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-49747f48-dbcc-4675-b909-6bb2ee73d60c tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-5bcfce8d-898a-4dff-b0ba-fc3951344631-delete_volume'" released by "delete_volume" :: held 2.692s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:44.360627 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:44.440079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:44.440467 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513356232]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:46:44.441291 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:46:44.442277 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:44.458481 n-d-760454-3 sudo[12352]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:46:44.459020 n-d-760454-3 sudo[12352]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:44.917580 n-d-760454-3 sudo[12352]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:44.920518 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.477s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:44.922980 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:44.939730 n-d-760454-3 sudo[12356]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:46:44.940304 n-d-760454-3 sudo[12356]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:45.163576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:45.299173 n-d-760454-3 sudo[12356]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:45.301109 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.378s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:45.302931 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:45.319631 n-d-760454-3 sudo[12360]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:46:45.320278 n-d-760454-3 sudo[12360]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:45.856077 n-d-760454-3 sudo[12360]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:45.858978 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-b9761505-e4d6-4abf-9638-72ef80fa8531" returned: 0 in 0.555s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:45.860266 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: b9761505-e4d6-4abf-9638-72ef80fa8531
Jan 25 13:46:45.985893 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['e489dadc-b1c8-46c8-b79b-7d0e78a00e17', 'cd2f1f65-23fe-40e3-a134-a6f12ddb1380', 'ea140b16-9322-47a0-8ff9-9f9e7b4074c6', '4deb45b7-fd65-4d42-bf7c-ac2d7afaa58c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:45.988338 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:45.988338 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:45.988338 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:46.117096 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:46.117745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:46.134403 n-d-760454-3 sudo[12369]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:46.134943 n-d-760454-3 sudo[12369]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:46.175355 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:46.493663 n-d-760454-3 sudo[12369]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:46.495666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.378s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:46.497314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:46.513378 n-d-760454-3 sudo[12374]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:46.514174 n-d-760454-3 sudo[12374]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:46.660090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-dd887af0-ea6b-4109-b16f-ff449c96e0a3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:46.662737 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:46.682198 n-d-760454-3 sudo[12376]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3
Jan 25 13:46:46.682746 n-d-760454-3 sudo[12376]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:46.986649 n-d-760454-3 sudo[12374]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:46.988999 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:46.990761 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:46.996201 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:47.045741 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-be08a97c-bb9b-484b-919a-086acdb6e59b tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-b9761505-e4d6-4abf-9638-72ef80fa8531-delete_volume'" released by "delete_volume" :: held 2.796s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:47.175293 n-d-760454-3 sudo[12376]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:47.178424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3" returned: 0 in 0.516s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:47.180012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:47.197533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:47.197747 n-d-760454-3 sudo[12384]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3
Jan 25 13:46:47.198297 n-d-760454-3 sudo[12384]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:47.797725 n-d-760454-3 sudo[12384]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:47.799969 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-dd887af0-ea6b-4109-b16f-ff449c96e0a3" returned: 0 in 0.620s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:47.940673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['53531c03-eb14-4bb6-8420-0661a44a6022', '53d7a330-e693-47e0-9020-f03f0d228db1', '684f3aac-7d6c-45bf-a1c0-66637c5da93e', '17e2b62c-4632-4d70-9c33-d63328c4c09e'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:47.942647 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:47.942647 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:47.942647 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:48.031784 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Delete snapshot completed successfully.
Jan 25 13:46:48.037322 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-64eb3479-d2f1-4b2f-8585-6ce1adc6a03f tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-dd887af0-ea6b-4109-b16f-ff449c96e0a3-delete_snapshot'" released by "delete_snapshot" :: held 1.378s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:48.203033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:48.980430 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-d7a6347d-1f38-407a-8948-a144b22f09f6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:46:49.072389 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:49.151975 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.081s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:49.152362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:46:49.153155 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Skipping remove_export. No iscsi_target is presently exported for volume: d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:46:49.154146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:49.170842 n-d-760454-3 sudo[12429]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:46:49.171449 n-d-760454-3 sudo[12429]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:49.214773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:49.630877 n-d-760454-3 sudo[12429]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:49.632869 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.478s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:49.634079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:49.650399 n-d-760454-3 sudo[12433]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:46:49.650997 n-d-760454-3 sudo[12433]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:50.010960 n-d-760454-3 sudo[12433]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:50.013329 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.379s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:50.015708 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:50.033162 n-d-760454-3 sudo[12437]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:46:50.033811 n-d-760454-3 sudo[12437]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:50.227613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:50.531905 n-d-760454-3 sudo[12437]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:50.533899 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-d7a6347d-1f38-407a-8948-a144b22f09f6" returned: 0 in 0.518s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:50.535068 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Successfully deleted volume: d7a6347d-1f38-407a-8948-a144b22f09f6
Jan 25 13:46:50.620586 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Created reservations ['d3e38304-a197-4ee8-b6de-d33abfeae7a2', '44b2f5b5-8ab7-4ef9-a27c-93d68a11f4a7', '4fdccb1a-68b0-4a34-a786-222db94ee8ec', '2d8f43de-0b8e-47a7-b230-2ddeebcb268b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:46:50.623022 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:46:50.623022 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:46:50.623022 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:46:50.772185 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:46:50.773043 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:50.790301 n-d-760454-3 sudo[12447]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:46:50.790846 n-d-760454-3 sudo[12447]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:51.142030 n-d-760454-3 sudo[12447]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:51.144836 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.371s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:51.146776 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:46:51.163659 n-d-760454-3 sudo[12451]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:46:51.164314 n-d-760454-3 sudo[12451]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:46:51.240636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:51.641080 n-d-760454-3 sudo[12451]: pam_unix(sudo:session): session closed for user root
Jan 25 13:46:51.643022 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:46:51.644656 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:46:51.651018 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Deleted volume successfully.
Jan 25 13:46:51.688011 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-584488ae-2bdc-4ec1-aa33-10b277de27a6 tempest-VolumesSnapshotTestJSON-954851200 None] Lock "b'cinder-d7a6347d-1f38-407a-8948-a144b22f09f6-delete_volume'" released by "delete_volume" :: held 2.708s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:46:52.247831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:53.254232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:54.259982 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:55.265859 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:56.271411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:57.276848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:58.283173 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:46:59.289557 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:00.294660 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:01.303779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:02.310894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:03.316999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:04.322755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:05.331412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:06.336916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:07.343878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:07.961402 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aef9044a-12e9-422a-b8bb-4118f990aff8 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:07.977938 n-d-760454-3 sudo[12467]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:47:07.978502 n-d-760454-3 sudo[12467]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:08.351302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:08.448358 n-d-760454-3 sudo[12467]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:08.450351 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aef9044a-12e9-422a-b8bb-4118f990aff8 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.489s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:08.451422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aef9044a-12e9-422a-b8bb-4118f990aff8 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d --snapshot stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -L 1.00g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:08.467520 n-d-760454-3 sudo[12472]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d --snapshot stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -L 1.00g
Jan 25 13:47:08.468061 n-d-760454-3 sudo[12472]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:09.246268 n-d-760454-3 sudo[12472]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:09.248556 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-aef9044a-12e9-422a-b8bb-4118f990aff8 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate --name _snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d --snapshot stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -L 1.00g" returned: 0 in 0.797s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:09.357612 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:09.397378 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-aef9044a-12e9-422a-b8bb-4118f990aff8 tempest-TestVolumeBootPattern-1757403332 None] Create snapshot completed successfully
Jan 25 13:47:10.363749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:10.899851 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 13:47:10.904482 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 13:47:10.905079 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 13:47:10.941418 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (bb25afb0-103f-4c02-9800-d83f2d263121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:47:10.947862 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ca7484-6f4f-4a21-9d6d-fae9bfa2e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:10.991323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 13:47:11.019507 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ca7484-6f4f-4a21-9d6d-fae9bfa2e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T13:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-881287249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=e903633c-c772-41f1-95bf-9ac77329a462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6759d3eee66f4453b064fcf9a5f5d756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T13:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5ab5872-4afa-4841-aa0e-d0ae06fbc61d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T13:47:11Z,user_id='e05ff2642a9b43da927aa763694ac642',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:11.022962 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b9bdd0-35f9-44bd-9a41-f5e0f28e4451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:11.024523 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b9bdd0-35f9-44bd-9a41-f5e0f28e4451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:11.026629 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84af301e-2037-4b66-a055-32b82e716b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:11.029001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84af301e-2037-4b66-a055-32b82e716b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e903633c-c772-41f1-95bf-9ac77329a462', 'volume_name': 'volume-e903633c-c772-41f1-95bf-9ac77329a462', 'volume_size': 1, 'snapshot_id': 'c5ab5872-4afa-4841-aa0e-d0ae06fbc61d'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:11.032242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b6f92-f74b-4444-abe1-4128fb9f17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:11.034510 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b6f92-f74b-4444-abe1-4128fb9f17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:11.036840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2456cf-2259-452a-a749-40f520e55120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:11.037697 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Volume e903633c-c772-41f1-95bf-9ac77329a462: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e903633c-c772-41f1-95bf-9ac77329a462', 'volume_size': 1, 'snapshot_id': 'c5ab5872-4afa-4841-aa0e-d0ae06fbc61d'}
Jan 25 13:47:11.060547 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e903633c-c772-41f1-95bf-9ac77329a462 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:11.083147 n-d-760454-3 sudo[12573]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e903633c-c772-41f1-95bf-9ac77329a462 stack-volumes-lvmdriver-1 -L 1g
Jan 25 13:47:11.083966 n-d-760454-3 sudo[12573]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:11.373679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:11.630441 n-d-760454-3 sudo[12573]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:11.632404 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-e903633c-c772-41f1-95bf-9ac77329a462 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.572s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:11.634253 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:11.651280 n-d-760454-3 sudo[12604]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d
Jan 25 13:47:11.651830 n-d-760454-3 sudo[12604]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:12.018007 n-d-760454-3 sudo[12604]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:12.020507 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:12.022927 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 iflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:12.039152 n-d-760454-3 sudo[12608]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 iflag=direct
Jan 25 13:47:12.039701 n-d-760454-3 sudo[12608]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:12.378639 n-d-760454-3 sudo[12608]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:12.382658 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:12.383597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 iflag=direct" returned: 0 in 0.361s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:12.384607 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:12.401363 n-d-760454-3 sudo[12618]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 oflag=direct
Jan 25 13:47:12.401910 n-d-760454-3 sudo[12618]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:12.745472 n-d-760454-3 sudo[12618]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:12.748391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 oflag=direct" returned: 0 in 0.363s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:12.750090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:12.769436 n-d-760454-3 sudo[12628]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct
Jan 25 13:47:12.770011 n-d-760454-3 sudo[12628]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:13.393734 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:14.400443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:15.407509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:16.414130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:17.420845 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:18.427924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:19.434448 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:20.442200 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:22.243259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:22.454648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:23.460360 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:24.642712 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:25.472332 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:26.479969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:27.486374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:28.497437 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:29.503584 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:30.510152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:31.516125 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:32.522044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:33.527808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:34.533937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:35.540671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:36.546878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:37.552652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:38.557731 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:39.563877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:40.569990 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:41.575904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:42.582686 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:43.588820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:44.048070 n-d-760454-3 sudo[12628]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:44.050051 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd if=/dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d of=/dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462 count=1073741824 bs=1M iflag=count_bytes,direct oflag=direct" returned: 0 in 31.300s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:44.050659 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Volume copy details: src /dev/mapper/stack--volumes--lvmdriver--1-_snapshot--c5ab5872--4afa--4841--aa0e--d0ae06fbc61d, dest /dev/mapper/stack--volumes--lvmdriver--1-volume--e903633c--c772--41f1--95bf--9ac77329a462, size 1024.00 MB, duration 31.30 sec {{(pid=89244) _copy_volume_with_path /opt/stack/cinder/cinder/volume/volume_utils.py:504}}
Jan 25 13:47:44.051076 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.volume_utils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Volume copy 1024.00 MB at 32.71 MB/s
Jan 25 13:47:44.098281 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Marking volume e903633c-c772-41f1-95bf-9ac77329a462 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 13:47:44.160648 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Copying metadata from snapshot c5ab5872-4afa-4841-aa0e-d0ae06fbc61d to e903633c-c772-41f1-95bf-9ac77329a462. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:418}}
Jan 25 13:47:44.302755 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2456cf-2259-452a-a749-40f520e55120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e903633c-c772-41f1-95bf-9ac77329a462', 'volume_size': 1, 'snapshot_id': 'c5ab5872-4afa-4841-aa0e-d0ae06fbc61d'}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:44.305897 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7368c4-8f10-4bd2-8511-bea65854ddf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 13:47:44.455070 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Volume volume-e903633c-c772-41f1-95bf-9ac77329a462 (e903633c-c772-41f1-95bf-9ac77329a462): created successfully
Jan 25 13:47:44.455070 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7368c4-8f10-4bd2-8511-bea65854ddf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 13:47:44.457222 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Flow 'volume_create_manager' (bb25afb0-103f-4c02-9800-d83f2d263121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 13:47:44.594584 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:44.640436 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-331f1b15-739e-4440-94f5-14f7a3b5d38c tempest-TestVolumeBootPattern-1757403332 None] Created volume successfully.
Jan 25 13:47:45.600671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:46.606736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:47.177599 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:47:47.178332 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:47:47.179704 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:47.220491 n-d-760454-3 sudo[12716]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:47:47.221835 n-d-760454-3 sudo[12716]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:47.601880 n-d-760454-3 sudo[12716]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:47.604006 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:47.605283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:47.623199 n-d-760454-3 sudo[12720]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:47:47.624888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:47.624372 n-d-760454-3 sudo[12720]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:48.417813 n-d-760454-3 sudo[12720]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:48.420305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.815s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:48.423329 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:47:48.629039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:49.635002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:50.642436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:51.054106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:51.073605 n-d-760454-3 sudo[12725]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:47:51.074160 n-d-760454-3 sudo[12725]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:47:51.511414 n-d-760454-3 sudo[12725]: pam_unix(sudo:session): session closed for user root
Jan 25 13:47:51.513890 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462" returned: 0 in 0.459s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:51.572476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:51.581723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 13:47:51.592891 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Creating iscsi_target for Volume ID: volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Created volume path /opt/stack/data/cinder/volumes/volume-e903633c-c772-41f1-95bf-9ac77329a462,
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462>
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:     incominguser cFL8Xs7L8LxXMGnjHskS 98TVQP7eTqeGyD65
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:     
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 13:47:51.728358 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 13:47:51.737533 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:51.744129 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:52.299582 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462" returned: 0 in 0.568s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:52.301414 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:47:52.302346 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 13:47:52.303541 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 13:47:52.305257 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:52.317782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.012s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462\n            Backing store flags: \n    Account information:\n        cFL8Xs7L8LxXMGnjHskS\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         I_T nexus: 42
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Connection: 1
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:                 IP Address: 10.222.0.30
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         6QhmEtbJv5sWJe8siis4
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 13:47:52.321392 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 13:47:52.325369 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:52.420129 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.097s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:52.420800 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462\n            Backing store flags: \n    Account information:\n        cFL8Xs7L8LxXMGnjHskS\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:47:52.427613 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:47:52.554502 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.128s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:47:52.555182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462\n            Backing store flags: \n    Account information:\n        cFL8Xs7L8LxXMGnjHskS\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:47:52.556600 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] Set provider_location to: 10.222.0.65:3260,2 iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 13:47:52.749916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:53.293739 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-e0de19f8-4540-4882-8435-61bcbe5f5bf4 req-f9f49a3f-1cce-4372-8d5a-dc41281cf9e8 tempest-TestVolumeBootPattern-1757403332 None] attachment_update completed successfully.
Jan 25 13:47:53.763549 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:54.774584 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:55.781822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:56.788124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:57.793123 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:58.804699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:47:59.811493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:00.816520 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:01.825946 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:02.832193 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:03.837103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:04.844058 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:05.849943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:06.856464 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:07.863777 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:08.870670 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:09.875868 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:10.882486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:11.890449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:12.898974 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:13.917505 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:14.915736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:15.922171 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:16.928150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:17.934919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:18.941172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:19.946727 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:20.960613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:21.958840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:22.964203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:23.970569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:24.975161 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:25.981116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:26.987216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:28.019677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:29.009118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:30.007907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:31.012579 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:32.017160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:33.019216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:34.025546 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:35.031060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:36.037393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:37.043834 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:38.050338 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:39.057802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:40.062856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:41.069814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:42.075688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:43.292937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:44.087632 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:45.094902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:46.108482 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:47.108854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:47.181128 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:48:47.181731 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:48:47.182753 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:48:47.204140 n-d-760454-3 sudo[13160]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:48:47.204738 n-d-760454-3 sudo[13160]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:48:47.569203 n-d-760454-3 sudo[13160]: pam_unix(sudo:session): session closed for user root
Jan 25 13:48:47.571945 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:48:47.572949 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:48:47.589972 n-d-760454-3 sudo[13164]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:48:47.590486 n-d-760454-3 sudo[13164]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:48:48.119060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:48.315372 n-d-760454-3 sudo[13164]: pam_unix(sudo:session): session closed for user root
Jan 25 13:48:48.317204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.744s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:48:48.318037 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:48:49.126800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:50.132753 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:51.139053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:52.146003 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:53.153247 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:54.159048 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:55.164122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:56.170190 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:57.176201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:58.182223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:48:59.188304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:00.194153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:01.199890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:02.205764 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:03.212156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:04.218544 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:05.224054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:06.230019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:07.235883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:08.242691 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:09.247649 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:10.253226 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:11.259136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:12.265345 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:13.271257 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:14.276857 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:15.283539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:16.290978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:17.296771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:18.302606 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:19.308355 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:20.314251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:21.319771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:22.325114 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:23.330910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:24.337871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:25.344144 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:26.350799 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:27.356145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:28.361968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:29.367521 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:30.373852 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:31.380069 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:32.387153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:33.395296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:34.402208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:35.413749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:36.421094 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:37.432024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:38.438089 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:39.445114 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:40.454924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:41.460806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:42.468962 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:43.475243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:44.482246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:45.487347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:46.506667 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:47.186150 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:49:47.186650 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:49:47.187449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:49:47.203898 n-d-760454-3 sudo[13557]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:49:47.204760 n-d-760454-3 sudo[13557]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:49:47.513558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:47.605138 n-d-760454-3 sudo[13557]: pam_unix(sudo:session): session closed for user root
Jan 25 13:49:47.607686 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:49:47.608961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:49:47.626204 n-d-760454-3 sudo[13571]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:49:47.626849 n-d-760454-3 sudo[13571]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:49:48.355783 n-d-760454-3 sudo[13571]: pam_unix(sudo:session): session closed for user root
Jan 25 13:49:48.358210 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:49:48.359127 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:49:48.521839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:49.527417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:50.532513 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:51.538807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:52.543765 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:53.549563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:54.555453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:55.563825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:56.568527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:57.574180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:58.585604 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:49:59.592820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:00.598529 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:01.603547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:02.609408 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:03.615306 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:04.620643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:05.625771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:06.632348 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:07.637233 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:08.643193 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:09.648860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:10.655314 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:11.661931 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:12.667529 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:13.673704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:14.679395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:15.684491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:16.689950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:17.695755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:18.701984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:19.707581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:20.712688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:21.718340 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:22.723916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:23.730961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:24.737006 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:25.742906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:26.749212 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:27.755797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:28.761271 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:29.767032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:30.778465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:31.784129 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:32.789733 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:33.795629 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:34.802456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:35.808817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:36.815617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:37.821212 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:38.827771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:39.833919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:40.840443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:41.845477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:42.851297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:43.857143 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:44.862805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:45.869301 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:46.877994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:47.189721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:50:47.190137 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:50:47.190959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:50:47.208788 n-d-760454-3 sudo[13645]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:50:47.209382 n-d-760454-3 sudo[13645]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:50:47.737627 n-d-760454-3 sudo[13645]: pam_unix(sudo:session): session closed for user root
Jan 25 13:50:47.739741 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:50:47.741105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:50:47.758999 n-d-760454-3 sudo[13649]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:50:47.759544 n-d-760454-3 sudo[13649]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:50:47.889991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:48.444022 n-d-760454-3 sudo[13649]: pam_unix(sudo:session): session closed for user root
Jan 25 13:50:48.446833 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:50:48.447583 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:50:48.895996 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:49.902217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:50.907875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:51.913144 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:52.919224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:53.926132 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:54.931385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:55.938157 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:56.944357 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:57.950156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:58.955982 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:50:59.961976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:00.969759 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:01.975260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:02.981493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:03.987302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:04.992960 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:05.999743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:07.005181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:08.011260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:09.017030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:10.022826 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:11.029356 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:12.034966 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:13.040663 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:14.046025 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:15.051664 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:16.058641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:17.064484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:18.070143 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:19.075493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:20.081277 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:21.087014 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:22.095943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:23.104261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:24.111142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:25.116866 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:26.123236 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:27.128571 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:28.134103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:29.140307 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:29.184629 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-4306e998-442d-4172-a49b-255fef607fae req-1bc9cb37-0686-41a8-946e-ced99d99e3d0 tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:51:29.185867 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-4306e998-442d-4172-a49b-255fef607fae req-1bc9cb37-0686-41a8-946e-ced99d99e3d0 tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 5cded9d7-8ab6-4f2c-a6e3-0f157ccf8e45. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:51:29.188131 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:29.266480 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:29.266982 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\nTarget 2: iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00020000\n            SCSI SN: beaf20\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00020001\n            SCSI SN: beaf21\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462\n            Backing store flags: \n    Account information:\n        cFL8Xs7L8LxXMGnjHskS\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:29.267742 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-4306e998-442d-4172-a49b-255fef607fae req-1bc9cb37-0686-41a8-946e-ced99d99e3d0 tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:29.268993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:29.379813 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-e903633c-c772-41f1-95bf-9ac77329a462 -f" returned: 0 in 0.110s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:29.380266 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:29.381639 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:29.460698 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:29.460854 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:29.573728 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-4306e998-442d-4172-a49b-255fef607fae req-1bc9cb37-0686-41a8-946e-ced99d99e3d0 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:51:29.573728 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:51:29.573728 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:51:30.147945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:31.153989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:31.325549 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-e903633c-c772-41f1-95bf-9ac77329a462-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:51:31.422963 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:31.500096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:31.500482 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n        I_T nexus: 42\n            Initiator: iqn.1991-05.com.microsoft:n-h2-760454-3.cbci-760454-3.local alias: none\n            Connection: 1\n                IP Address: 10.222.0.30\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:31.501244 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:31.502136 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:31.518088 n-d-760454-3 sudo[13708]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:31.518696 n-d-760454-3 sudo[13708]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:32.046436 n-d-760454-3 sudo[13708]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:32.049342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462" returned: 0 in 0.547s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:32.050605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:32.067204 n-d-760454-3 sudo[13712]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:32.067786 n-d-760454-3 sudo[13712]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:32.161431 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:32.417873 n-d-760454-3 sudo[13712]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:32.419705 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462" returned: 0 in 0.369s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:32.421605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:32.438297 n-d-760454-3 sudo[13717]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:32.438912 n-d-760454-3 sudo[13717]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:32.964503 n-d-760454-3 sudo[13717]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:32.966961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-e903633c-c772-41f1-95bf-9ac77329a462" returned: 0 in 0.545s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:32.968659 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: e903633c-c772-41f1-95bf-9ac77329a462
Jan 25 13:51:33.055132 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['b823ee4e-043b-4e0c-ade4-60f1028a54f9', '4229ceff-bc19-4fba-aaa3-c618a8333a03', 'f6b65f57-70db-4158-b6d0-7c68c7c65f83', '43b472e2-c6cd-4e77-83f5-f48c12e1179c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:51:33.058087 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:51:33.058087 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:51:33.058087 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:51:33.168287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:33.180973 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:51:33.181820 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:33.197933 n-d-760454-3 sudo[13726]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:51:33.198523 n-d-760454-3 sudo[13726]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:33.551398 n-d-760454-3 sudo[13726]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:33.553797 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.371s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:33.556035 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:33.573271 n-d-760454-3 sudo[13730]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:51:33.573899 n-d-760454-3 sudo[13730]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:33.740320 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:51:33.742997 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:33.760666 n-d-760454-3 sudo[13732]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d
Jan 25 13:51:33.761362 n-d-760454-3 sudo[13732]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:34.061253 n-d-760454-3 sudo[13730]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:34.063699 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:34.066091 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:51:34.074360 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:51:34.133022 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-58666ffb-a8f6-4b3f-acdd-9e7fdc16e945 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-e903633c-c772-41f1-95bf-9ac77329a462-delete_volume'" released by "delete_volume" :: held 2.807s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:51:34.173254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:34.262295 n-d-760454-3 sudo[13732]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:34.264080 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d" returned: 0 in 0.521s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:34.265720 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:34.281964 n-d-760454-3 sudo[13739]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d
Jan 25 13:51:34.282582 n-d-760454-3 sudo[13739]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:34.893571 n-d-760454-3 sudo[13739]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:34.896111 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/_snapshot-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d" returned: 0 in 0.630s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:35.032896 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['f18cf6e8-f40c-45a9-a7f4-286f0e85a49e', 'cba94a04-dc72-409a-a84f-3d212161425b', '1596ef67-87b6-4b8c-b2f4-2fb9e999178a', '33b70c33-cb72-4bbe-aa1e-81289e2de286'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:51:35.034837 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:51:35.034837 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:51:35.034837 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:51:35.173785 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Delete snapshot completed successfully.
Jan 25 13:51:35.180944 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:35.186355 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c4786804-bab4-4028-a4af-2cd4d7d631f5 tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-c5ab5872-4afa-4841-aa0e-d0ae06fbc61d-delete_snapshot'" released by "delete_snapshot" :: held 1.446s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:51:36.187860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:37.194240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:38.200569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:39.207889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:40.216131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:41.222973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:42.228518 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:42.460026 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-50d66e5e-ba7b-4f10-a60b-4b94701c06ab req-4a24ef5e-817c-4a85-b911-abb7c55854e2 tempest-TestVolumeBootPattern-1757403332 None] Terminate volume connection completed successfully.
Jan 25 13:51:42.460229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-50d66e5e-ba7b-4f10-a60b-4b94701c06ab req-4a24ef5e-817c-4a85-b911-abb7c55854e2 tempest-TestVolumeBootPattern-1757403332 None] Deleting attachment 08566fb7-d73d-414f-b845-640644bf5adb. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 13:51:42.461868 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:42.543170 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.081s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:42.543551 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576\n            Backing store flags: \n    Account information:\n        6QhmEtbJv5sWJe8siis4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:42.544319 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-50d66e5e-ba7b-4f10-a60b-4b94701c06ab req-4a24ef5e-817c-4a85-b911-abb7c55854e2 tempest-TestVolumeBootPattern-1757403332 None] Removing iscsi_target for Volume ID: 94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:42.545892 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:42.646721 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 -f" returned: 0 in 0.101s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:42.647096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:42.648415 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:42.725558 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:42.725932 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:42.852330 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-50d66e5e-ba7b-4f10-a60b-4b94701c06ab req-4a24ef5e-817c-4a85-b911-abb7c55854e2 tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:51:42.852330 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:51:42.852330 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:51:43.233704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:44.240284 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:45.245201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:46.251613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:46.374684 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-94092ae1-bc5e-4971-a4e2-73ad375b7576-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 13:51:46.465982 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:46.544275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:46.544674 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 13:51:46.545378 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Skipping remove_export. No iscsi_target is presently exported for volume: 94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:46.546214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:46.563003 n-d-760454-3 sudo[13829]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:46.563727 n-d-760454-3 sudo[13829]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:47.073434 n-d-760454-3 sudo[13829]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:47.075801 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.529s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:47.077066 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:47.093688 n-d-760454-3 sudo[13835]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:47.094299 n-d-760454-3 sudo[13835]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:47.186511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:51:47.186909 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:51:47.187784 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:47.205797 n-d-760454-3 sudo[13837]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:51:47.206377 n-d-760454-3 sudo[13837]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:47.264079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:47.461234 n-d-760454-3 sudo[13835]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:47.463318 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:47.465293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:47.498263 n-d-760454-3 sudo[13841]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:47.498873 n-d-760454-3 sudo[13841]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:47.565583 n-d-760454-3 sudo[13837]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:47.567815 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.380s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:47.570167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:47.587752 n-d-760454-3 sudo[13845]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:51:47.588321 n-d-760454-3 sudo[13845]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:48.068339 n-d-760454-3 sudo[13841]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:48.071153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-94092ae1-bc5e-4971-a4e2-73ad375b7576" returned: 0 in 0.605s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:48.073236 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Successfully deleted volume: 94092ae1-bc5e-4971-a4e2-73ad375b7576
Jan 25 13:51:48.099352 n-d-760454-3 sudo[13845]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:48.101296 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:48.104092 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:51:48.209964 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Created reservations ['18d07867-f3c9-4f22-9884-883ec77057ad', '30804633-d28f-4510-ad16-d8572c442812', 'f3fbf6bb-bd76-47c3-be51-c9bc0f91f0c1', '1611bffa-1952-4b6f-af3c-064cf31ae9b8'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 13:51:48.213056 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 13:51:48.213056 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 13:51:48.213056 n-d-760454-3 cinder-volume[89138]: 
Jan 25 13:51:48.277676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:48.333676 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:51:48.334396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:48.351746 n-d-760454-3 sudo[13857]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:51:48.352370 n-d-760454-3 sudo[13857]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:48.734616 n-d-760454-3 sudo[13857]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:48.736957 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:48.739039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:51:48.755394 n-d-760454-3 sudo[13861]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:51:48.755963 n-d-760454-3 sudo[13861]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:51:49.286183 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:49.391213 n-d-760454-3 sudo[13861]: pam_unix(sudo:session): session closed for user root
Jan 25 13:51:49.393475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:51:49.395478 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:51:49.401535 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Deleted volume successfully.
Jan 25 13:51:49.460074 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-db8c21e7-5e87-4f02-a6ad-cfc64721724f tempest-TestVolumeBootPattern-1757403332 None] Lock "b'cinder-94092ae1-bc5e-4971-a4e2-73ad375b7576-delete_volume'" released by "delete_volume" :: held 3.085s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 13:51:50.293681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:51.299336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:52.305108 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:53.310824 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:54.317182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:55.324243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:56.330326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:57.337494 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:58.343042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:51:59.350700 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:00.356434 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:01.363688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:02.370877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:03.376488 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:04.381782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:05.387600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:06.394365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:07.401867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:08.407501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:09.413265 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:10.418829 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:11.424778 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:12.430681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:13.436833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:14.443098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:15.449079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:16.456162 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:17.461635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:18.467482 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:19.472991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:20.478619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:21.484887 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:22.489778 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:23.495503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:24.501423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:25.507135 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:26.513102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:27.518727 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:28.524822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:29.531616 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:30.537060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:31.542807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:32.550568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:33.555912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:34.562284 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:35.567958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:36.573900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:37.580519 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:38.586378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:39.595019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:40.599441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:41.605642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:42.612188 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:43.618907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:44.623990 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:45.630089 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:46.635655 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:47.182246 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:52:47.182572 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:52:47.183379 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:52:47.203926 n-d-760454-3 sudo[14025]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:52:47.204499 n-d-760454-3 sudo[14025]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:52:47.619089 n-d-760454-3 sudo[14025]: pam_unix(sudo:session): session closed for user root
Jan 25 13:52:47.621496 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:52:47.623469 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:52:47.643982 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:47.646159 n-d-760454-3 sudo[14029]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:52:47.647066 n-d-760454-3 sudo[14029]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:52:48.249946 n-d-760454-3 sudo[14029]: pam_unix(sudo:session): session closed for user root
Jan 25 13:52:48.252007 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:52:48.252979 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:52:48.649527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:49.655386 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:50.661812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:51.667776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:52.673282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:53.679240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:54.684755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:55.689926 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:56.695672 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:57.701669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:58.715554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:52:59.721140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:00.731701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:01.737359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:02.744833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:03.750893 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:04.756680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:05.763219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:06.768606 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:07.773798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:08.779512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:09.785413 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:10.791115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:11.798346 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:12.803983 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:13.809323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:14.815716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:15.822074 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:16.827973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:17.832859 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:18.839090 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:19.844834 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:20.850470 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:21.855174 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:22.861335 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:23.866927 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:24.872385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:25.879675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:26.886290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:27.893377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:28.899551 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:29.905200 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:30.910580 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:31.916097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:32.922760 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:33.927455 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:34.933018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:35.938435 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:36.944267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:37.949984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:38.955818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:39.960949 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:40.966940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:41.972803 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:42.978262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:43.984026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:44.989837 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:46.008606 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:47.001215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:47.179344 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:53:47.179916 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:53:47.180526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:53:47.198373 n-d-760454-3 sudo[14110]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:53:47.198952 n-d-760454-3 sudo[14110]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:53:47.580141 n-d-760454-3 sudo[14110]: pam_unix(sudo:session): session closed for user root
Jan 25 13:53:47.582726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:53:47.584716 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:53:47.602649 n-d-760454-3 sudo[14114]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:53:47.603242 n-d-760454-3 sudo[14114]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:53:48.009159 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:48.200604 n-d-760454-3 sudo[14114]: pam_unix(sudo:session): session closed for user root
Jan 25 13:53:48.202703 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:53:48.203603 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:53:49.016124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:50.023272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:51.029564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:52.035566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:53.041443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:54.048002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:55.053421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:56.059918 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:57.065145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:58.070805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:53:59.076890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:00.082545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:01.088235 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:02.094912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:03.100512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:04.106102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:05.110870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:06.116576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:07.122522 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:08.130938 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:09.137085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:10.143020 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:11.157815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:12.163725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:13.169024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:14.174412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:15.183398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:16.192071 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:17.196958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:18.203211 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:19.208694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:20.214897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:21.220891 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:22.226319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:23.232053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:24.237560 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:25.242586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:26.248297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:27.253943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:28.259711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:29.265421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:30.271041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:31.277313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:32.283042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:33.288628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:34.294393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:35.299001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:36.304742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:37.310740 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:38.316080 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:39.322674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:40.330688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:41.337539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:42.343635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:43.348607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:44.353955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:45.359743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:46.365472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:47.182342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:54:47.183175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:54:47.183983 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:54:47.201666 n-d-760454-3 sudo[14170]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:54:47.202205 n-d-760454-3 sudo[14170]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:54:47.373092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:47.577687 n-d-760454-3 sudo[14170]: pam_unix(sudo:session): session closed for user root
Jan 25 13:54:47.579587 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.396s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:54:47.580792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:54:47.599725 n-d-760454-3 sudo[14174]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:54:47.600306 n-d-760454-3 sudo[14174]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:54:48.192951 n-d-760454-3 sudo[14174]: pam_unix(sudo:session): session closed for user root
Jan 25 13:54:48.195152 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:54:48.196032 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:54:48.379928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:49.385159 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:50.390807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:51.395870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:52.401818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:53.407480 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:54.413848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:55.419593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:56.425865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:57.432411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:58.437152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:54:59.442701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:00.447906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:01.453305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:02.459030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:03.465189 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:04.471038 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:05.476306 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:06.483457 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:07.489483 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:08.499421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:09.504796 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:10.510584 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:11.516351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:12.521820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:13.527290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:14.532587 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:15.539131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:16.545313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:17.552293 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:18.557848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:19.563243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:20.568111 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:21.573294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:22.579653 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:23.586050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:24.591960 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:25.598252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:26.604436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:27.609060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:28.614697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:29.620574 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:30.626343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:31.632218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:32.638287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:33.643432 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:34.649899 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:35.655648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:36.661539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:37.667539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:38.673115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:39.679186 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:40.685010 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:41.690782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:42.696558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:43.702377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:44.708106 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:45.714628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:46.720453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:47.182916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:55:47.183270 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:55:47.184078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:55:47.201780 n-d-760454-3 sudo[14190]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:55:47.202396 n-d-760454-3 sudo[14190]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:55:47.567254 n-d-760454-3 sudo[14190]: pam_unix(sudo:session): session closed for user root
Jan 25 13:55:47.569476 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:55:47.570733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:55:47.587684 n-d-760454-3 sudo[14194]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:55:47.588238 n-d-760454-3 sudo[14194]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:55:47.728425 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:48.145476 n-d-760454-3 sudo[14194]: pam_unix(sudo:session): session closed for user root
Jan 25 13:55:48.147812 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:55:48.148552 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:55:48.734423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:49.740377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:50.746134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:51.751308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:52.757043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:53.762325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:54.767753 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:55.774064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:56.779683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:57.785214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:58.791137 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:55:59.796894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:00.802569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:01.808783 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:02.814217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:03.820325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:04.827457 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:05.833562 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:06.840619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:07.845341 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:08.850933 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:09.856766 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:10.862694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:11.874210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:12.880902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:13.886616 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:14.892401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:15.899391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:16.907439 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:17.914600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:18.919701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:19.925093 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:20.930558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:21.936401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:22.941366 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:23.947607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:24.953264 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:25.959536 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:26.965078 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:27.970640 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:28.977011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:29.982200 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:30.988030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:31.993945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:32.999914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:34.005755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:35.011763 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:36.017498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:37.023377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:38.029054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:39.034682 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:40.040571 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:41.045831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:42.051656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:43.057436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:44.062997 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:45.070648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:46.076118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:47.082222 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:47.185449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:56:47.185766 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:56:47.186564 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:56:47.205248 n-d-760454-3 sudo[14208]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:56:47.205789 n-d-760454-3 sudo[14208]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:56:47.605238 n-d-760454-3 sudo[14208]: pam_unix(sudo:session): session closed for user root
Jan 25 13:56:47.607474 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:56:47.608766 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:56:47.624925 n-d-760454-3 sudo[14214]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:56:47.625487 n-d-760454-3 sudo[14214]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:56:48.090641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:48.231054 n-d-760454-3 sudo[14214]: pam_unix(sudo:session): session closed for user root
Jan 25 13:56:48.232909 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:56:48.233715 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:56:49.095759 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:50.102263 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:51.107700 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:52.113744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:53.119858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:54.125380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:55.132408 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:56.138392 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:57.144012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:58.150158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:56:59.155778 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:00.161915 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:01.167579 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:02.173243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:03.179060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:04.184643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:05.190312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:06.196345 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:07.202098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:08.207653 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:09.212988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:10.218738 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:11.223581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:12.229045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:13.234784 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:14.240297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:15.245171 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:16.251687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:17.257566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:18.263694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:19.269516 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:20.275356 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:21.287696 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:22.293442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:23.299007 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:24.304631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:25.310177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:26.316017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:27.321681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:28.327791 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:29.333998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:30.340318 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:31.345204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:32.351179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:33.356855 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:34.363207 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:35.368658 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:36.374138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:37.379821 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:38.385313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:39.391352 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:40.397595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:41.403468 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:42.409818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:43.416416 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:44.421234 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:45.427087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:46.433586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:47.191424 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:57:47.191985 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:57:47.192910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:57:47.216240 n-d-760454-3 sudo[14532]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:57:47.216817 n-d-760454-3 sudo[14532]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:57:47.441373 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:47.650449 n-d-760454-3 sudo[14532]: pam_unix(sudo:session): session closed for user root
Jan 25 13:57:47.652363 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:57:47.653606 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:57:47.672365 n-d-760454-3 sudo[14548]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:57:47.673058 n-d-760454-3 sudo[14548]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:57:48.305099 n-d-760454-3 sudo[14548]: pam_unix(sudo:session): session closed for user root
Jan 25 13:57:48.307464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:57:48.308373 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:57:48.448769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:49.454217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:50.460397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:51.466053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:52.471908 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:53.478593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:54.484364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:55.490782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:56.496569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:57.502958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:58.509002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:57:59.514809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:00.521653 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:01.527510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:02.533277 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:03.539499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:04.544798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:05.550362 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:06.555965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:07.561648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:08.567633 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:09.573297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:10.578935 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:11.585282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:12.591431 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:13.597815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:14.603528 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:15.609930 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:16.615486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:17.621324 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:18.626804 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:19.632707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:20.638405 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:21.644153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:22.650158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:23.655189 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:24.661397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:25.667243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:26.672940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:27.678664 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:28.684306 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:29.690428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:30.695666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:31.701196 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:32.707367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:33.713351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:34.719397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:35.725713 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:36.731304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:37.736985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:38.742741 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:39.748737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:40.754904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:41.760749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:42.766360 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:43.772864 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:44.777919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:45.783321 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:46.788927 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:47.196309 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:58:47.196752 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:58:47.197605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:58:47.214754 n-d-760454-3 sudo[14572]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:58:47.215329 n-d-760454-3 sudo[14572]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:58:47.607420 n-d-760454-3 sudo[14572]: pam_unix(sudo:session): session closed for user root
Jan 25 13:58:47.612955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:58:47.612955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:58:47.628373 n-d-760454-3 sudo[14578]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:58:47.628973 n-d-760454-3 sudo[14578]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:58:47.796751 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:48.231204 n-d-760454-3 sudo[14578]: pam_unix(sudo:session): session closed for user root
Jan 25 13:58:48.233137 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:58:48.234028 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:58:48.802744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:49.808029 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:50.813841 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:51.818889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:52.824916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:53.830446 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:54.835502 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:55.841347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:56.847232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:57.853043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:58.858677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:58:59.864247 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:00.870655 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:01.881221 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:02.887261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:03.893285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:04.900878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:05.906604 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:06.912382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:07.917929 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:08.922769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:09.928418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:10.933928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:11.939558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:12.945838 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:13.952311 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:14.958379 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:15.964824 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:16.970535 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:17.976595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:18.981889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:19.987219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:20.994103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:21.999585 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:23.005199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:24.011715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:25.017456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:26.023304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:27.030380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:28.036174 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:29.042955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:30.049029 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:31.055997 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:32.061738 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:33.069879 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:34.076684 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:35.083479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:36.090079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:37.096872 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:38.103644 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:39.109576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:40.115391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:41.122868 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:42.128829 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:43.134789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:44.140722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:45.146598 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:46.153158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:47.158936 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:47.200828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 13:59:47.201418 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 13:59:47.202026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:59:47.218934 n-d-760454-3 sudo[14592]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 13:59:47.219509 n-d-760454-3 sudo[14592]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:59:47.618624 n-d-760454-3 sudo[14592]: pam_unix(sudo:session): session closed for user root
Jan 25 13:59:47.620900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:59:47.622252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 13:59:47.640602 n-d-760454-3 sudo[14598]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 13:59:47.641145 n-d-760454-3 sudo[14598]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 13:59:48.166267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:48.205899 n-d-760454-3 sudo[14598]: pam_unix(sudo:session): session closed for user root
Jan 25 13:59:48.207830 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 13:59:48.208681 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 13:59:49.171838 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:50.177678 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:51.183231 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:52.189258 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:53.195566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:54.201575 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:55.208263 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:56.215721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:57.221126 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:58.227452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 13:59:59.234063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:00.239163 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:01.245718 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:02.251379 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:03.256998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:04.262907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:05.267972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:06.273626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:07.280241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:08.285195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:09.291481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:10.297054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:11.304889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:12.310664 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:13.317425 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:14.323113 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:15.328840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:16.335251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:17.341039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:18.347881 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:19.353873 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:20.359627 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:21.366545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:22.372165 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:23.377948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:24.383139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:25.389097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:26.394704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:27.400770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:28.406635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:29.413453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:30.418998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:31.425050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:32.431181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:33.443307 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:34.448752 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:35.454069 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:36.460409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:37.467050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:38.472890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:39.478515 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:40.484285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:41.489948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:42.495664 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:43.501806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:44.508511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:45.514562 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:46.520937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:47.205725 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:00:47.206212 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:00:47.207153 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:00:47.225343 n-d-760454-3 sudo[14656]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:00:47.226162 n-d-760454-3 sudo[14656]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:00:47.531106 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:47.605945 n-d-760454-3 sudo[14656]: pam_unix(sudo:session): session closed for user root
Jan 25 14:00:47.607938 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:00:47.609417 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:00:47.626755 n-d-760454-3 sudo[14662]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:00:47.627291 n-d-760454-3 sudo[14662]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:00:48.210854 n-d-760454-3 sudo[14662]: pam_unix(sudo:session): session closed for user root
Jan 25 14:00:48.213178 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:00:48.214067 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:00:48.538233 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:49.544742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:50.550370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:51.555877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:52.562334 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:53.568249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:54.574120 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:55.579435 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:56.584824 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:57.590622 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:58.596363 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:00:59.601848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:00.607419 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:01.612742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:02.618068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:03.623622 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:04.632326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:05.638057 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:06.644656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:07.650228 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:08.658169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:09.663893 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:10.670698 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:11.676878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:12.682687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:13.688473 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:14.694656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:15.700887 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:16.706684 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:17.711875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:18.718153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:19.724282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:20.730180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:21.735994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:22.742019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:23.747978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:24.754052 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:25.759472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:26.764802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:27.770817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:28.776042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:29.782387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:30.789620 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:31.795189 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:32.801643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:33.807317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:34.813141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:35.819116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:36.825091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:37.831204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:38.837041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:39.843218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:40.848959 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:41.854559 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:42.860784 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:43.865917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:44.871505 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:45.876639 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:46.881924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:47.211195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:01:47.211611 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:01:47.212435 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:01:47.229791 n-d-760454-3 sudo[14726]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:01:47.230332 n-d-760454-3 sudo[14726]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:01:47.643828 n-d-760454-3 sudo[14726]: pam_unix(sudo:session): session closed for user root
Jan 25 14:01:47.646050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:01:47.647358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:01:47.665172 n-d-760454-3 sudo[14732]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:01:47.665796 n-d-760454-3 sudo[14732]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:01:47.890382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:48.242998 n-d-760454-3 sudo[14732]: pam_unix(sudo:session): session closed for user root
Jan 25 14:01:48.244840 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:01:48.245790 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:01:48.896276 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:49.903753 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:50.912808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:51.917973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:52.928078 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:53.934957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:54.939966 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:55.945238 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:56.951098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:57.956816 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:58.962463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:01:59.967988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:00.973974 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:01.979869 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:02.986023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:03.991914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:04.997487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:06.003981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:07.009246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:08.015119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:09.021154 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:10.026659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:11.033001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:12.038135 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:13.043674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:14.049753 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:15.055569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:16.062805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:17.075883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:18.081625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:19.087295 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:20.092370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:21.098744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:22.104353 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:23.110245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:24.115928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:25.121908 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:26.127217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:27.132743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:28.138512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:29.144499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:30.150439 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:31.157068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:32.162701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:33.168841 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:34.175484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:35.181109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:36.187195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:37.192748 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:38.201713 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:39.207981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:40.213862 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:41.220147 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:42.226011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:43.231892 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:44.237843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:45.243282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:46.248721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:47.212019 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:02:47.212459 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:02:47.213305 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:02:47.230357 n-d-760454-3 sudo[14748]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:02:47.230932 n-d-760454-3 sudo[14748]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:02:47.270801 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:47.604190 n-d-760454-3 sudo[14748]: pam_unix(sudo:session): session closed for user root
Jan 25 14:02:47.606101 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.393s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:02:47.607281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:02:47.623556 n-d-760454-3 sudo[14754]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:02:47.624168 n-d-760454-3 sudo[14754]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:02:48.226884 n-d-760454-3 sudo[14754]: pam_unix(sudo:session): session closed for user root
Jan 25 14:02:48.229118 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:02:48.230009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:02:48.262840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:49.268522 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:50.275163 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:51.281493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:52.287136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:53.292909 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:54.299039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:55.304852 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:56.311812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:57.317580 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:58.323385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:02:59.328923 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:00.334685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:01.340302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:02.345218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:03.350917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:04.356776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:05.361600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:06.367369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:07.373527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:08.379198 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:09.384716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:10.390234 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:11.395893 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:12.401614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:13.407999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:14.413544 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:15.419127 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:16.425019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:17.430554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:18.436786 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:19.442437 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:20.448167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:21.453744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:22.459218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:23.465152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:24.470969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:25.476510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:26.483339 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:27.489237 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:28.494684 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:29.500403 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:30.505699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:31.511675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:32.517561 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:33.523973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:34.530600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:35.535888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:36.541527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:37.548374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:38.553085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:39.557735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:40.564694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:41.570064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:42.575581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:43.581179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:44.586589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:45.592477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:46.598075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:47.217684 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:03:47.218528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:03:47.219592 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:03:47.241791 n-d-760454-3 sudo[14768]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:03:47.245556 n-d-760454-3 sudo[14768]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:03:47.605783 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:47.635067 n-d-760454-3 sudo[14768]: pam_unix(sudo:session): session closed for user root
Jan 25 14:03:47.637291 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:03:47.639157 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:03:47.655974 n-d-760454-3 sudo[14774]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:03:47.656551 n-d-760454-3 sudo[14774]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:03:48.281892 n-d-760454-3 sudo[14774]: pam_unix(sudo:session): session closed for user root
Jan 25 14:03:48.283997 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:03:48.285282 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:03:48.613371 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:49.619339 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:50.626210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:51.632058 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:52.638917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:53.645303 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:54.651302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:55.657659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:56.669330 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:57.675498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:58.681498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:03:59.687674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:00.693302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:01.698950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:02.704509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:03.710101 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:04.715364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:05.721008 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:06.729654 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:07.736957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:08.747900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:09.748936 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:10.754735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:11.760185 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:12.765377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:13.771593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:14.777631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:15.783401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:16.788133 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:17.793798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:18.799570 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:19.804961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:20.810884 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:21.817367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:22.824452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:23.836224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:24.842353 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:25.848580 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:26.854420 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:27.860167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:28.866140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:29.872930 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:30.878586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:31.884138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:32.891397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:33.899122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:34.905394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:35.911430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:36.917444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:37.924090 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:38.929106 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:39.935149 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:40.940724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:41.946436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:42.952675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:43.958401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:44.964275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:45.970121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:46.975981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:47.222505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:04:47.223837 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:04:47.225288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:04:47.244317 n-d-760454-3 sudo[14881]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:04:47.244916 n-d-760454-3 sudo[14881]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:04:47.615852 n-d-760454-3 sudo[14881]: pam_unix(sudo:session): session closed for user root
Jan 25 14:04:47.618097 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.393s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:04:47.619438 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:04:47.637546 n-d-760454-3 sudo[14887]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:04:47.638099 n-d-760454-3 sudo[14887]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:04:47.984374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:48.206710 n-d-760454-3 sudo[14887]: pam_unix(sudo:session): session closed for user root
Jan 25 14:04:48.208495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:04:48.209636 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:04:48.990473 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:49.996167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:51.002169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:52.007680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:53.013967 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:54.019409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:55.025547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:56.032141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:57.038223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:58.043965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:04:59.049631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:00.055817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:01.061645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:02.067808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:03.073511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:04.079187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:05.085002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:06.091303 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:07.097514 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:08.103078 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:09.108831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:10.115452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:11.121788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:12.127502 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:13.133467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:14.139726 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:15.144526 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:16.150758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:17.156639 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:18.162663 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:19.168377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:20.174011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:21.179588 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:22.186087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:23.192449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:24.198144 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:25.205272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:26.212068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:27.217932 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:28.224299 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:29.230349 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:30.236106 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:31.241853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:32.247967 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:33.253466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:34.258529 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:35.263708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:36.271605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:37.277272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:38.283121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:39.289044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:40.295593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:41.300631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:42.307107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:43.313367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:44.319493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:45.325883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:46.331960 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:47.228026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:05:47.228378 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:05:47.229249 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:05:47.245866 n-d-760454-3 sudo[14901]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:05:47.246438 n-d-760454-3 sudo[14901]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:05:47.340130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:47.615487 n-d-760454-3 sudo[14901]: pam_unix(sudo:session): session closed for user root
Jan 25 14:05:47.617555 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:05:47.618777 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:05:47.641895 n-d-760454-3 sudo[14907]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:05:47.642745 n-d-760454-3 sudo[14907]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:05:48.260179 n-d-760454-3 sudo[14907]: pam_unix(sudo:session): session closed for user root
Jan 25 14:05:48.262407 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:05:48.263286 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:05:48.346921 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:49.352941 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:50.359275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:51.365485 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:52.372017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:53.378744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:54.384622 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:55.389986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:56.397570 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:57.403598 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:58.409559 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:05:59.415390 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:00.421117 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:01.426796 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:02.432716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:03.440122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:04.445932 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:05.451007 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:06.457046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:07.463632 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:08.469380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:09.475115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:10.480815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:11.486674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:12.492466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:13.498363 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:14.503523 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:15.510077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:16.516104 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:17.521441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:18.528113 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:19.534169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:20.541058 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:21.546666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:22.553023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:23.559009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:24.569621 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:25.574985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:26.580433 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:27.585372 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:28.591053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:29.596761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:30.603068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:31.609051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:32.614828 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:33.620731 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:34.626795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:35.643340 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:36.650283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:37.656950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:38.662459 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:39.668179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:40.674136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:41.680219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:42.685245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:43.690678 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:44.696366 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:45.701780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:46.710962 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:47.230659 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:06:47.231105 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:06:47.232202 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:06:47.249572 n-d-760454-3 sudo[14952]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:06:47.250173 n-d-760454-3 sudo[14952]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:06:47.648234 n-d-760454-3 sudo[14952]: pam_unix(sudo:session): session closed for user root
Jan 25 14:06:47.658689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:06:47.658689 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:06:47.670343 n-d-760454-3 sudo[14966]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:06:47.670917 n-d-760454-3 sudo[14966]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:06:47.718115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:48.254144 n-d-760454-3 sudo[14966]: pam_unix(sudo:session): session closed for user root
Jan 25 14:06:48.256009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:06:48.257653 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:06:48.723448 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:49.729858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:50.735898 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:51.741618 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:52.747224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:53.752844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:54.758570 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:55.764114 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:56.770127 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:57.776561 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:58.782347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:06:59.789159 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:00.796017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:01.802461 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:02.809091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:03.816720 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:04.824377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:05.830124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:06.836190 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:07.841375 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:08.847067 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:09.853365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:10.859060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:11.864964 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:12.870168 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:13.876270 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:14.882832 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:15.888195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:16.893903 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:17.898871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:18.904672 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:19.910869 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:20.917412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:21.978830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:22.927769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:23.933185 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:24.938544 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:25.944039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:26.950479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:27.955506 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:28.961342 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:29.966304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:30.971920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:31.977704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:32.983286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:33.988814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:34.995516 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:36.001853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:37.007285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:38.012979 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:39.018909 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:40.025184 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:41.031016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:42.036883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:43.043496 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:44.048875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:45.054363 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:46.062287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:47.068073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:47.227241 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:07:47.227539 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:07:47.228345 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:07:47.244838 n-d-760454-3 sudo[14992]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:07:47.245404 n-d-760454-3 sudo[14992]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:07:47.617718 n-d-760454-3 sudo[14992]: pam_unix(sudo:session): session closed for user root
Jan 25 14:07:47.619865 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.391s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:07:47.621247 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:07:47.638818 n-d-760454-3 sudo[14998]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:07:47.639359 n-d-760454-3 sudo[14998]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:07:48.075630 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:48.221909 n-d-760454-3 sudo[14998]: pam_unix(sudo:session): session closed for user root
Jan 25 14:07:48.223710 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:07:48.224593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:07:49.081760 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:50.087767 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:51.093956 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:52.099414 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:53.106258 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:54.111605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:55.118434 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:56.124815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:57.130500 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:58.137628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:07:59.143572 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:00.152246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:01.158127 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:02.164382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:03.170250 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:04.175593 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:05.181294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:06.187509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:07.193208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:08.199356 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:09.205191 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:10.211081 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:11.222781 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:12.228150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:13.234225 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:14.240059 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:15.245902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:16.253417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:17.258406 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:18.264165 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:19.269012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:20.274275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:21.279200 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:22.284917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:23.290221 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:24.295952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:25.302180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:26.308645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:27.314098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:28.319946 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:29.326093 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:30.331615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:31.337297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:32.343015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:33.348586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:34.355008 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:35.360770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:36.366675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:37.372625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:38.378545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:39.384411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:40.389228 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:41.394185 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:42.399719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:43.406639 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:44.413179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:45.418316 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:46.423107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:47.232968 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:08:47.233299 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:08:47.234110 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:08:47.251353 n-d-760454-3 sudo[15012]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:08:47.251928 n-d-760454-3 sudo[15012]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:08:47.430286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:47.631455 n-d-760454-3 sudo[15012]: pam_unix(sudo:session): session closed for user root
Jan 25 14:08:47.633595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.399s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:08:47.634848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:08:47.651370 n-d-760454-3 sudo[15016]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:08:47.651940 n-d-760454-3 sudo[15016]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:08:48.230772 n-d-760454-3 sudo[15016]: pam_unix(sudo:session): session closed for user root
Jan 25 14:08:48.232947 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:08:48.234000 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:08:48.436428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:49.442010 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:50.447667 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:51.453238 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:52.458001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:53.463395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:54.468371 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:55.473701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:56.479708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:57.485523 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:58.491826 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:08:59.497497 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:00.503150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:01.509333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:02.514731 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:03.523315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:04.529151 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:05.534950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:06.541812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:07.548428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:08.553880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:09.559704 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:10.564977 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:11.571015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:12.576197 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:13.581824 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:14.587278 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:15.592922 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:15.806152 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 14:09:15.810555 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 14:09:15.811108 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 14:09:15.825620 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Flow 'volume_create_manager' (660decac-636c-4966-b9b2-c7fd97fc6b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:09:15.830587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473acead-da97-449f-a00a-9d33dd51e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:15.854971 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 14:09:15.882687 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473acead-da97-449f-a00a-9d33dd51e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T14:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1456825844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=349de28c-8ee3-41d3-8221-497d6393e6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b60b515744048dabdccc18280a7d410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T14:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T14:09:16Z,user_id='8c245de87b564a93bb2e61437b9338b7',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:15.885412 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9562c2-8da7-45c6-903b-088695690895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:15.887758 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9562c2-8da7-45c6-903b-088695690895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:15.890356 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e9a480-a179-45e8-84e9-411b45d387f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:15.892763 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e9a480-a179-45e8-84e9-411b45d387f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349de28c-8ee3-41d3-8221-497d6393e6f9', 'volume_name': 'volume-349de28c-8ee3-41d3-8221-497d6393e6f9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:15.895297 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd1eaf2-8215-499e-a884-532e5987e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:15.898182 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd1eaf2-8215-499e-a884-532e5987e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:15.900612 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f370a34-f935-4ee7-b4e0-752e204ceade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:15.901471 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Volume 349de28c-8ee3-41d3-8221-497d6393e6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349de28c-8ee3-41d3-8221-497d6393e6f9', 'volume_size': 1}
Jan 25 14:09:15.902595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-349de28c-8ee3-41d3-8221-497d6393e6f9 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:15.919514 n-d-760454-3 sudo[15026]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-349de28c-8ee3-41d3-8221-497d6393e6f9 stack-volumes-lvmdriver-1 -L 1g
Jan 25 14:09:15.920134 n-d-760454-3 sudo[15026]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:09:16.477757 n-d-760454-3 sudo[15026]: pam_unix(sudo:session): session closed for user root
Jan 25 14:09:16.480458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-349de28c-8ee3-41d3-8221-497d6393e6f9 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.577s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:16.484448 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f370a34-f935-4ee7-b4e0-752e204ceade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349de28c-8ee3-41d3-8221-497d6393e6f9', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:16.487119 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441a05d-dbce-4b55-83ce-9ef82c82c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:09:16.529897 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Volume volume-349de28c-8ee3-41d3-8221-497d6393e6f9 (349de28c-8ee3-41d3-8221-497d6393e6f9): created successfully
Jan 25 14:09:16.532295 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441a05d-dbce-4b55-83ce-9ef82c82c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:09:16.535629 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Flow 'volume_create_manager' (660decac-636c-4966-b9b2-c7fd97fc6b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:09:16.573401 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-94e102e4-dcf6-459a-ae27-8fa8a3d35d31 tempest-ServerActionsTestJSON-383655475 None] Created volume successfully.
Jan 25 14:09:16.600493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:17.606961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:18.316243 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:18.332990 n-d-760454-3 sudo[15059]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:18.334116 n-d-760454-3 sudo[15059]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:09:18.615657 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:18.690518 n-d-760454-3 sudo[15059]: pam_unix(sudo:session): session closed for user root
Jan 25 14:09:18.692572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.376s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:18.743593 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:18.749269 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:18.749632 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:18.750267 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:09:18.751133 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Creating iscsi_target for Volume ID: volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Created volume path /opt/stack/data/cinder/volumes/volume-349de28c-8ee3-41d3-8221-497d6393e6f9,
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9>
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:     incominguser HLYLt7HagkaPwNRLNVBE XCFsgDac4d6SRvXA
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:09:18.810120 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:09:18.815354 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:19.170745 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.360s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:19.171067 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:19.171706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:09:19.172113 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:09:19.173676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:19.179763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:19.180278 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:19.180945 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:09:19.182026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:19.259759 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:19.260146 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:19.261581 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:19.338408 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.076s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:19.338799 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:19.339880 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:09:19.589514 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-bde1d462-20a0-40ff-b37d-5d1bb83b707b req-14bd96bd-342d-46e5-8744-b4c8d04acab4 tempest-ServerActionsTestJSON-383655475 None] attachment_update completed successfully.
Jan 25 14:09:19.621590 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:20.627298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:21.632724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:22.638986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:23.643894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:24.649067 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:25.654485 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:26.660457 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:27.665539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:28.671028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:29.677227 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:30.683728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:31.689944 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:32.695136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:33.703060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:34.709045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:35.714822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:36.720458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:37.725888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:38.732201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:39.737217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:40.742689 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:41.748225 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:42.753105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:43.758918 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:44.764558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:45.770595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:46.776251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:47.232461 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:09:47.232911 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:09:47.233735 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:47.250913 n-d-760454-3 sudo[15101]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:09:47.251450 n-d-760454-3 sudo[15101]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:09:47.604832 n-d-760454-3 sudo[15101]: pam_unix(sudo:session): session closed for user root
Jan 25 14:09:47.606984 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:47.608229 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:47.625424 n-d-760454-3 sudo[15105]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:09:47.625986 n-d-760454-3 sudo[15105]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:09:47.785260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:47.947918 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-46721717-01c8-481d-9bae-7492df148cc7 req-5d899aab-9534-49b4-9751-1c2d558b5612 tempest-ServerActionsTestJSON-383655475 None] Terminate volume connection completed successfully.
Jan 25 14:09:47.948587 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-46721717-01c8-481d-9bae-7492df148cc7 req-5d899aab-9534-49b4-9751-1c2d558b5612 tempest-ServerActionsTestJSON-383655475 None] Deleting attachment ee50daaf-6575-4283-a656-d7b72b9e941c. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:09:48.046870 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-46721717-01c8-481d-9bae-7492df148cc7 req-5d899aab-9534-49b4-9751-1c2d558b5612 tempest-ServerActionsTestJSON-383655475 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:09:48.046870 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:09:48.046870 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:09:48.175336 n-d-760454-3 sudo[15105]: pam_unix(sudo:session): session closed for user root
Jan 25 14:09:48.177396 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:48.178835 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:09:48.791021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:49.797260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:50.802980 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:51.809187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:52.601257 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:52.618613 n-d-760454-3 sudo[15132]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:52.619145 n-d-760454-3 sudo[15132]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:09:52.817134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:52.981489 n-d-760454-3 sudo[15132]: pam_unix(sudo:session): session closed for user root
Jan 25 14:09:52.983336 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.382s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.034076 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:53.047041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.012s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.047377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         HLYLt7HagkaPwNRLNVBE
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:09:53.048054 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:09:53.051095 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Creating iscsi_target for Volume ID: volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:09:53.051095 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Persistence file already exists for volume, found file at: /opt/stack/data/cinder/volumes/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:153}}
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Created volume path /opt/stack/data/cinder/volumes/volume-349de28c-8ee3-41d3-8221-497d6393e6f9,
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9>
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:     incominguser HLYLt7HagkaPwNRLNVBE XCFsgDac4d6SRvXA
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:09:53.122855 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:09:53.124350 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:53.499891 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.375s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.500273 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:53.500965 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:09:53.501376 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:09:53.502811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:53.508570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.508964 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         HLYLt7HagkaPwNRLNVBE
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:09:53.509560 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:09:53.514640 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:53.589325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.589707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:53.591078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:09:53.669778 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:09:53.670279 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:09:53.671457 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:09:53.821822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:53.990842 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-46721717-01c8-481d-9bae-7492df148cc7 req-7645b638-28b7-4d2e-b696-804aeb8a7e7a tempest-ServerActionsTestJSON-383655475 None] attachment_update completed successfully.
Jan 25 14:09:54.827925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:55.833807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:56.838846 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:57.844620 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:58.849919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:09:59.854733 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:00.860289 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:01.865890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:02.871482 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:03.877706 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:04.886850 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:05.893016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:06.898155 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:07.903808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:08.066552 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-223be880-3102-487e-abaf-da0187f4c089 tempest-ServerActionsTestJSON-383655475 None] Terminate volume connection completed successfully.
Jan 25 14:10:08.067173 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-223be880-3102-487e-abaf-da0187f4c089 tempest-ServerActionsTestJSON-383655475 None] Deleting attachment bcf3b5d3-2e4a-48ab-aaaf-5266e2c9ba75. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:10:08.200788 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-223be880-3102-487e-abaf-da0187f4c089 tempest-ServerActionsTestJSON-383655475 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:10:08.200788 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:10:08.200788 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:10:08.910009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:09.917372 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:10.923911 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:11.933064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:12.795699 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:12.812628 n-d-760454-3 sudo[15201]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:12.813266 n-d-760454-3 sudo[15201]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:12.941238 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:13.212017 n-d-760454-3 sudo[15201]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:13.214208 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.419s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.264218 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:13.273681 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.009s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.274275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         HLYLt7HagkaPwNRLNVBE
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:10:13.274918 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:10:13.277373 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Creating iscsi_target for Volume ID: volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:10:13.277373 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Persistence file already exists for volume, found file at: /opt/stack/data/cinder/volumes/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:153}}
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Created volume path /opt/stack/data/cinder/volumes/volume-349de28c-8ee3-41d3-8221-497d6393e6f9,
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9>
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:     incominguser HLYLt7HagkaPwNRLNVBE XCFsgDac4d6SRvXA
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:10:13.356493 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:10:13.359723 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:13.724271 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.366s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.724809 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:13.725494 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:10:13.725907 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:10:13.727276 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:13.733323 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.733691 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         HLYLt7HagkaPwNRLNVBE
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:10:13.734275 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:10:13.738198 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:13.814823 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.815231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:13.816633 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:13.896181 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:13.896724 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:13.897795 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:10:13.952426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:14.238903 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-a82f7340-ac55-4f4b-abf0-3837c4b63572 req-deb68cd0-a580-419c-9c93-d7d6ba7c74f4 tempest-ServerActionsTestJSON-383655475 None] attachment_update completed successfully.
Jan 25 14:10:14.958725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:15.963863 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:16.969156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:17.975164 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:18.980715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:19.986697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:20.992393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:21.997961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:23.003986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:24.009685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:25.015162 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:26.020848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:27.026252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:28.032685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:29.038168 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:30.046053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:31.048007 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:31.089761 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-8f65098e-f764-4024-ab08-ff2a24f5a0bb req-6b566a3d-17cd-46f3-82a6-19a04212182d tempest-ServerActionsTestJSON-383655475 None] Terminate volume connection completed successfully.
Jan 25 14:10:31.090206 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-8f65098e-f764-4024-ab08-ff2a24f5a0bb req-6b566a3d-17cd-46f3-82a6-19a04212182d tempest-ServerActionsTestJSON-383655475 None] Deleting attachment 9f95636c-e46f-4926-9133-ab70289f416c. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:10:31.091874 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:31.176712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:31.177120 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9\n            Backing store flags: \n    Account information:\n        HLYLt7HagkaPwNRLNVBE\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:31.178080 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-8f65098e-f764-4024-ab08-ff2a24f5a0bb req-6b566a3d-17cd-46f3-82a6-19a04212182d tempest-ServerActionsTestJSON-383655475 None] Removing iscsi_target for Volume ID: 349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:31.180643 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:31.264884 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-349de28c-8ee3-41d3-8221-497d6393e6f9 -f" returned: 0 in 0.085s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:31.265806 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:31.267050 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:31.346387 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:31.346840 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:31.469407 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-8f65098e-f764-4024-ab08-ff2a24f5a0bb req-6b566a3d-17cd-46f3-82a6-19a04212182d tempest-ServerActionsTestJSON-383655475 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:10:31.469407 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:10:31.469407 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:10:32.054182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:33.060830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:33.983596 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Lock "b'cinder-349de28c-8ee3-41d3-8221-497d6393e6f9-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 14:10:34.086464 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:34.118026 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:34.195811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:34.196186 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:10:34.196924 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Skipping remove_export. No iscsi_target is presently exported for volume: 349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:34.197817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:34.214625 n-d-760454-3 sudo[15290]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:34.215171 n-d-760454-3 sudo[15290]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:34.747338 n-d-760454-3 sudo[15290]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:34.749756 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.551s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:34.750933 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:34.767013 n-d-760454-3 sudo[15294]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:34.767776 n-d-760454-3 sudo[15294]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:35.094072 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:35.128134 n-d-760454-3 sudo[15294]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:35.130372 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.379s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:35.132335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:35.150060 n-d-760454-3 sudo[15298]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:35.150751 n-d-760454-3 sudo[15298]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:35.661565 n-d-760454-3 sudo[15298]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:35.663662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-349de28c-8ee3-41d3-8221-497d6393e6f9" returned: 0 in 0.531s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:35.664824 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Successfully deleted volume: 349de28c-8ee3-41d3-8221-497d6393e6f9
Jan 25 14:10:35.767036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Created reservations ['0897336c-9b83-4a45-9813-1ec809b4c790', '0fc9f9cc-7d20-42d3-b20a-22e978727a76', '1096781f-fe72-4d6d-a2b3-9308ec26427f', '4bc69464-c084-4230-ad19-9cac87feb02b'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 14:10:35.769474 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:10:35.769474 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:10:35.769474 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:10:35.909707 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:10:35.910523 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:35.927755 n-d-760454-3 sudo[15307]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:10:35.928474 n-d-760454-3 sudo[15307]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:36.102795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:36.297116 n-d-760454-3 sudo[15307]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:36.298993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:36.300696 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:36.317493 n-d-760454-3 sudo[15311]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:10:36.318101 n-d-760454-3 sudo[15311]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:36.842429 n-d-760454-3 sudo[15311]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:36.845061 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:36.850894 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:10:36.854054 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Deleted volume successfully.
Jan 25 14:10:36.948409 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-8e5405f8-ebf1-4e0f-b563-730a45aebd2b tempest-ServerActionsTestJSON-383655475 None] Lock "b'cinder-349de28c-8ee3-41d3-8221-497d6393e6f9-delete_volume'" released by "delete_volume" :: held 2.961s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 14:10:37.108420 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:38.114775 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:39.121515 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:40.127065 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:41.140866 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:42.146897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:43.155183 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:44.161735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:45.167369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:46.173441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:47.179461 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:47.235377 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:10:47.235783 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:10:47.236662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:47.254130 n-d-760454-3 sudo[15351]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:10:47.254768 n-d-760454-3 sudo[15351]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:47.628930 n-d-760454-3 sudo[15351]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:47.631163 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.394s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:47.632415 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:10:47.648939 n-d-760454-3 sudo[15355]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:10:47.649480 n-d-760454-3 sudo[15355]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:10:48.170816 n-d-760454-3 sudo[15355]: pam_unix(sudo:session): session closed for user root
Jan 25 14:10:48.172955 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:10:48.173826 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:10:48.185508 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:49.192012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:50.197622 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:51.202968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:52.208955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:53.214413 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:54.220034 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:55.225828 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:56.231510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:57.237044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:58.245858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:10:59.251647 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:00.257273 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:01.267499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:02.274506 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:03.280313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:04.285261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:05.290939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:06.296802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:07.301625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:08.307333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:09.312275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:10.317410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:11.323416 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:12.328979 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:13.335323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:14.340360 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:15.345599 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:16.351509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:17.359959 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:18.365838 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:19.371341 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:20.376829 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:21.382424 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:22.388249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:23.393178 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:24.399623 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:25.405465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:26.411160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:27.417064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:28.421788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:29.428421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:30.433863 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:31.439659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:32.448205 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:33.454007 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:34.460724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:35.465940 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:36.472880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:37.479023 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:38.484963 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:39.492607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:40.499304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:41.504360 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:42.509026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:43.514246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:44.519496 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:45.525108 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:46.530471 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:47.239601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:11:47.240001 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:11:47.240919 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:11:47.259006 n-d-760454-3 sudo[15454]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:11:47.259626 n-d-760454-3 sudo[15454]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:11:47.538576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:47.633345 n-d-760454-3 sudo[15454]: pam_unix(sudo:session): session closed for user root
Jan 25 14:11:47.635560 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:11:47.637189 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:11:47.658566 n-d-760454-3 sudo[15458]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:11:47.659092 n-d-760454-3 sudo[15458]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:11:48.268141 n-d-760454-3 sudo[15458]: pam_unix(sudo:session): session closed for user root
Jan 25 14:11:48.271009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:11:48.271866 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:11:48.545611 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:49.552951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:50.558359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:51.567504 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:52.573157 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:53.579214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:54.585761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:55.591845 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:56.596984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:57.602982 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:58.608441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:11:59.614048 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:00.619354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:01.624668 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:02.630780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:03.637167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:04.643411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:05.650532 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:06.656754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:07.663985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:08.669262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:09.673993 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:10.679434 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:11.684501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:12.689517 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:13.695644 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:14.701036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:15.706447 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:16.712943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:17.718452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:18.725327 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:19.730720 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:20.737423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:21.744450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:22.750737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:23.756867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:24.762814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:25.770769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:26.778692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:27.784458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:28.790045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:29.797115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:30.805844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:31.816834 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:32.826849 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:33.835018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:34.840921 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:35.847287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:36.854692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:37.861423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:38.868073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:39.873530 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:40.880912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:41.889065 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:42.895924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:43.901613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:44.909071 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:45.914910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:46.920572 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:47.241739 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:12:47.242052 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:12:47.242848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:12:47.260317 n-d-760454-3 sudo[16244]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:12:47.261020 n-d-760454-3 sudo[16244]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:12:47.644784 n-d-760454-3 sudo[16244]: pam_unix(sudo:session): session closed for user root
Jan 25 14:12:47.646967 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:12:47.648204 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:12:47.664845 n-d-760454-3 sudo[16248]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:12:47.665474 n-d-760454-3 sudo[16248]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:12:47.935223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:48.311572 n-d-760454-3 sudo[16248]: pam_unix(sudo:session): session closed for user root
Jan 25 14:12:48.313511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:12:48.314354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:12:48.941027 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:49.946515 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:50.952100 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:51.970153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:52.980552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:53.988169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:54.995645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:56.001598 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:57.008018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:58.015005 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:12:59.022107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:00.030814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:01.037863 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:02.044375 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:03.050985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:04.056968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:05.063398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:06.070348 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:07.074933 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:08.081034 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:09.086626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:10.092447 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:11.100454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:12.106245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:13.112155 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:14.117652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:15.123474 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:16.129631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:16.572922 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 14:13:16.577642 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 14:13:16.578188 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 14:13:16.592377 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Flow 'volume_create_manager' (55a93c1b-f25a-4afd-a677-15a019308cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:13:16.595835 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a812d701-b62f-44fd-b396-7066494f0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:16.619968 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 14:13:16.647766 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a812d701-b62f-44fd-b396-7066494f0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T14:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestEncryptedCinderVolumes-volume-1444161219',ec2_id=None,encryption_key_id=00000000-0000-0000-0000-000000000000,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=55d3a734-3bf9-45dd-abf1-72c9324680aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6275cd6f9b742cab718a9d1c3e5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T14:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T14:13:16Z,user_id='61eb06ce951b488b8992b4444be381df',volume_attachment=<?>,volume_type=VolumeType(b80a2162-7cac-4b7d-9890-a1b40dab781c),volume_type_id=b80a2162-7cac-4b7d-9890-a1b40dab781c)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:16.650319 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a4d5f-b944-4656-98b4-a6f545502bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:16.652527 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a4d5f-b944-4656-98b4-a6f545502bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:16.655188 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3f36a-a5b9-4394-aa03-9313fcd4ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:16.657750 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3f36a-a5b9-4394-aa03-9313fcd4ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d3a734-3bf9-45dd-abf1-72c9324680aa', 'volume_name': 'volume-55d3a734-3bf9-45dd-abf1-72c9324680aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:16.660405 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e647b1-32a0-4e59-be70-375ceb8fc9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:16.662706 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e647b1-32a0-4e59-be70-375ceb8fc9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:16.665044 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db067750-89a0-496c-a6a7-58dcafe1fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:16.665897 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Volume 55d3a734-3bf9-45dd-abf1-72c9324680aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d3a734-3bf9-45dd-abf1-72c9324680aa', 'volume_size': 1}
Jan 25 14:13:16.667007 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55d3a734-3bf9-45dd-abf1-72c9324680aa stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:16.684076 n-d-760454-3 sudo[16289]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55d3a734-3bf9-45dd-abf1-72c9324680aa stack-volumes-lvmdriver-1 -L 1g
Jan 25 14:13:16.684671 n-d-760454-3 sudo[16289]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:17.138444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:17.285165 n-d-760454-3 sudo[16289]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:17.287690 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-55d3a734-3bf9-45dd-abf1-72c9324680aa stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.620s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:17.291117 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db067750-89a0-496c-a6a7-58dcafe1fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d3a734-3bf9-45dd-abf1-72c9324680aa', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:17.293642 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d5dae2-71e3-4c4f-9181-eed8c86f656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:13:17.319029 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Volume volume-55d3a734-3bf9-45dd-abf1-72c9324680aa (55d3a734-3bf9-45dd-abf1-72c9324680aa): created successfully
Jan 25 14:13:17.321138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d5dae2-71e3-4c4f-9181-eed8c86f656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:13:17.324521 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Flow 'volume_create_manager' (55a93c1b-f25a-4afd-a677-15a019308cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:13:17.359190 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-ac4769c2-04ff-4e24-b82b-609f42df68ee tempest-TestEncryptedCinderVolumes-2090501161 None] Created volume successfully.
Jan 25 14:13:18.144749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:18.710085 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:18.726276 n-d-760454-3 sudo[16322]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:18.726844 n-d-760454-3 sudo[16322]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:19.109577 n-d-760454-3 sudo[16322]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:19.111910 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa" returned: 0 in 0.401s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.164839 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:19.167771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:19.171167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.171712 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:19.172937 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:13:19.173777 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Creating iscsi_target for Volume ID: volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Created volume path /opt/stack/data/cinder/volumes/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa,
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa>
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:     incominguser 9F73RzDuoLBgA4e5KrQa 4AwC6Xv2P9ygTQs3
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:13:19.255528 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:13:19.257243 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:19.619949 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa" returned: 0 in 0.362s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.620325 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:19.620993 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:13:19.621407 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:13:19.622817 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:19.629079 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.629576 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n            Backing store flags: \n    Account information:\n        9F73RzDuoLBgA4e5KrQa\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:19.630590 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:13:19.631678 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:19.710753 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.711127 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n            Backing store flags: \n    Account information:\n        9F73RzDuoLBgA4e5KrQa\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:19.712526 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:19.789886 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:19.790267 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n            Backing store flags: \n    Account information:\n        9F73RzDuoLBgA4e5KrQa\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:19.791300 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:13:20.084187 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-d3281015-7388-484c-a1c7-c4795ab427d6 req-86d53106-6334-42be-ad9f-c8b13e53f98f tempest-TestEncryptedCinderVolumes-2090501161 None] attachment_update completed successfully.
Jan 25 14:13:20.173015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:21.179547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:22.184733 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:23.190519 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:24.195870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:25.201231 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:26.207048 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:27.212844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:27.540954 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-0b415cbf-c966-4e65-a253-1b056f259459 req-5abcddc8-5846-409f-bb3e-4c0f4e0d34bb tempest-TestEncryptedCinderVolumes-2090501161 None] Terminate volume connection completed successfully.
Jan 25 14:13:27.541354 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-0b415cbf-c966-4e65-a253-1b056f259459 req-5abcddc8-5846-409f-bb3e-4c0f4e0d34bb tempest-TestEncryptedCinderVolumes-2090501161 None] Deleting attachment b2e3f04b-3dd9-4b4a-81b0-b53d8ba9b11b. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:13:27.542940 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:27.622293 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:27.622868 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa\n            Backing store flags: \n    Account information:\n        9F73RzDuoLBgA4e5KrQa\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:27.623672 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-0b415cbf-c966-4e65-a253-1b056f259459 req-5abcddc8-5846-409f-bb3e-4c0f4e0d34bb tempest-TestEncryptedCinderVolumes-2090501161 None] Removing iscsi_target for Volume ID: 55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:27.624916 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:27.709109 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-55d3a734-3bf9-45dd-abf1-72c9324680aa -f" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:27.709473 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:27.710836 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:27.790804 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:27.791230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:27.901366 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-0b415cbf-c966-4e65-a253-1b056f259459 req-5abcddc8-5846-409f-bb3e-4c0f4e0d34bb tempest-TestEncryptedCinderVolumes-2090501161 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:13:27.901366 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:13:27.901366 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:13:28.218539 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:29.223880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:29.386831 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Lock "b'cinder-55d3a734-3bf9-45dd-abf1-72c9324680aa-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 14:13:29.481602 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:29.558539 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:29.558967 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:13:29.559809 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Skipping remove_export. No iscsi_target is presently exported for volume: 55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:29.560824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:29.577478 n-d-760454-3 sudo[16378]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:29.578022 n-d-760454-3 sudo[16378]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:30.097456 n-d-760454-3 sudo[16378]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:30.099776 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa" returned: 0 in 0.539s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:30.100991 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:30.117521 n-d-760454-3 sudo[16382]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:30.118161 n-d-760454-3 sudo[16382]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:30.235021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:30.468031 n-d-760454-3 sudo[16382]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:30.470044 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa" returned: 0 in 0.369s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:30.471898 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:30.488910 n-d-760454-3 sudo[16386]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:30.489454 n-d-760454-3 sudo[16386]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:31.013126 n-d-760454-3 sudo[16386]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:31.015560 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-55d3a734-3bf9-45dd-abf1-72c9324680aa" returned: 0 in 0.543s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:31.016913 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Successfully deleted volume: 55d3a734-3bf9-45dd-abf1-72c9324680aa
Jan 25 14:13:31.050619 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-cryptsetup-422552818 is set by the default quota flag: quota_volumes_tempest-scenario-type-cryptsetup-422552818, it is now deprecated. Please use the default quota class for default quota.
Jan 25 14:13:31.050619 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-cryptsetup-422552818 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-cryptsetup-422552818, it is now deprecated. Please use the default quota class for default quota.
Jan 25 14:13:31.101743 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Created reservations ['92e89f08-87de-4083-843f-ddb708bb44e7', '596691db-7c3e-4270-b4dc-bdf292bec0c8', '4bb146a9-3104-4c18-b435-2681cdac3b0f', 'b580cd80-0213-46e8-b55b-c813960189e7'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 14:13:31.104152 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:13:31.104152 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:13:31.104152 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:13:31.215970 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:13:31.216790 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:31.233699 n-d-760454-3 sudo[16395]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:13:31.234314 n-d-760454-3 sudo[16395]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:31.246895 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:31.589353 n-d-760454-3 sudo[16395]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:31.591343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.374s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:31.592965 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:31.609281 n-d-760454-3 sudo[16399]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:13:31.609855 n-d-760454-3 sudo[16399]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:32.150555 n-d-760454-3 sudo[16399]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:32.153160 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:32.154959 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:13:32.162571 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Deleted volume successfully.
Jan 25 14:13:32.233655 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-c8c52f8f-6699-4445-8564-0b17f0fa8ed7 tempest-TestEncryptedCinderVolumes-2090501161 None] Lock "b'cinder-55d3a734-3bf9-45dd-abf1-72c9324680aa-delete_volume'" released by "delete_volume" :: held 2.847s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 14:13:32.251945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:33.257643 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:34.262967 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:35.268697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:36.274891 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:37.281348 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:38.287412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:39.293282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:40.301157 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:41.307264 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:42.313132 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:43.319301 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:44.325440 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:45.336153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:46.341011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:47.242770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:13:47.243918 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:13:47.244860 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:47.262680 n-d-760454-3 sudo[16415]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:13:47.264026 n-d-760454-3 sudo[16415]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:47.350300 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:47.673389 n-d-760454-3 sudo[16415]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:47.675482 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:47.676688 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:13:47.702429 n-d-760454-3 sudo[16419]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:13:47.705941 n-d-760454-3 sudo[16419]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:13:48.357201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:48.435522 n-d-760454-3 sudo[16419]: pam_unix(sudo:session): session closed for user root
Jan 25 14:13:48.437491 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:13:48.438673 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:13:49.362912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:50.368432 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:51.374210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:52.380445 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:53.386087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:54.391747 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:55.397077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:56.403910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:57.410343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:58.415856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:13:59.421117 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:00.427215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:01.432554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:02.438442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:03.445826 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:04.452158 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:05.458361 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:06.464084 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:07.470454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:08.477301 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:09.483034 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:10.488968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:11.494831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:12.504739 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:13.514937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:14.521241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:15.525999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:16.531292 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:17.537032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:18.542321 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:19.547377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:20.553297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:21.558942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:21.845678 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 14:14:21.850300 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 14:14:21.850852 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 14:14:21.868252 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Flow 'volume_create_manager' (c287c4bb-fe83-4c15-a18f-e25ace27d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:14:21.871763 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c928b3bf-491f-4210-a3af-88a0b6228470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:21.897673 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 14:14:21.924379 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c928b3bf-491f-4210-a3af-88a0b6228470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T14:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestEncryptedCinderVolumes-volume-962797656',ec2_id=None,encryption_key_id=00000000-0000-0000-0000-000000000000,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=44819aac-43f7-47e3-b82a-7a88a350122d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6275cd6f9b742cab718a9d1c3e5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T14:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T14:14:22Z,user_id='61eb06ce951b488b8992b4444be381df',volume_attachment=<?>,volume_type=VolumeType(ac6b7ecc-56e6-4396-a72a-6cffbe2916a5),volume_type_id=ac6b7ecc-56e6-4396-a72a-6cffbe2916a5)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:21.927050 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4087ac-7604-4da5-8577-499e4e376db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:21.929349 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4087ac-7604-4da5-8577-499e4e376db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:21.932100 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b0cd7-2648-4576-b1e3-95809498f1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:21.934517 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b0cd7-2648-4576-b1e3-95809498f1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44819aac-43f7-47e3-b82a-7a88a350122d', 'volume_name': 'volume-44819aac-43f7-47e3-b82a-7a88a350122d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:21.936950 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2605db-abf8-4dce-9e4d-99cce4fce5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:21.939228 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2605db-abf8-4dce-9e4d-99cce4fce5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:21.942083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e99e30f-c393-4722-ad4d-fd3139ece71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:21.942933 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Volume 44819aac-43f7-47e3-b82a-7a88a350122d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44819aac-43f7-47e3-b82a-7a88a350122d', 'volume_size': 1}
Jan 25 14:14:21.944035 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44819aac-43f7-47e3-b82a-7a88a350122d stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:21.960667 n-d-760454-3 sudo[16461]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44819aac-43f7-47e3-b82a-7a88a350122d stack-volumes-lvmdriver-1 -L 1g
Jan 25 14:14:21.961317 n-d-760454-3 sudo[16461]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:22.548094 n-d-760454-3 sudo[16461]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:22.550606 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-44819aac-43f7-47e3-b82a-7a88a350122d stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.606s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:22.554275 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e99e30f-c393-4722-ad4d-fd3139ece71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44819aac-43f7-47e3-b82a-7a88a350122d', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:22.556818 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3487fa-9ca9-4192-8f22-ff7a8dffa705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:14:22.570215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:22.614906 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Volume volume-44819aac-43f7-47e3-b82a-7a88a350122d (44819aac-43f7-47e3-b82a-7a88a350122d): created successfully
Jan 25 14:14:22.617027 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3487fa-9ca9-4192-8f22-ff7a8dffa705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:14:22.620232 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Flow 'volume_create_manager' (c287c4bb-fe83-4c15-a18f-e25ace27d60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:14:22.660590 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-1e54d868-241d-43f7-baf1-f64292e0f972 tempest-TestEncryptedCinderVolumes-2090501161 None] Created volume successfully.
Jan 25 14:14:23.576941 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:23.983275 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:24.000051 n-d-760454-3 sudo[16492]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:24.000717 n-d-760454-3 sudo[16492]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:24.367581 n-d-760454-3 sudo[16492]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:24.369976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:24.422012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:24.428177 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:24.428569 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:24.429220 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:14:24.430094 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Creating iscsi_target for Volume ID: volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Created volume path /opt/stack/data/cinder/volumes/volume-44819aac-43f7-47e3-b82a-7a88a350122d,
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d>
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:     incominguser KXYTqiShLx7bdRVqK37R pvZ87HzqfoVYzf89
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:14:24.516833 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:14:24.518260 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:24.583045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:24.876378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d" returned: 0 in 0.358s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:24.876771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:24.877415 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:14:24.878216 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:14:24.879651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:24.885563 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:24.886138 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d\n            Backing store flags: \n    Account information:\n        KXYTqiShLx7bdRVqK37R\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:24.886743 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:14:24.887841 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:24.965252 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:24.965649 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d\n            Backing store flags: \n    Account information:\n        KXYTqiShLx7bdRVqK37R\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:24.967000 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:25.043960 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:25.044342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d\n            Backing store flags: \n    Account information:\n        KXYTqiShLx7bdRVqK37R\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:25.045424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:14:25.338017 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-f88856e7-cd4f-486a-8752-42808216319d req-aa82999c-cf9d-4b56-be97-bd4ee15ceef9 tempest-TestEncryptedCinderVolumes-2090501161 None] attachment_update completed successfully.
Jan 25 14:14:25.591773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:26.593617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:27.598774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:28.604308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:29.609854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:30.616033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:31.621484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:32.627812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:32.780238 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-436cc450-5a1f-4e06-9117-be72563c1f6c req-d8eea8c7-7dbe-4986-a4cb-06eb8f58ebb5 tempest-TestEncryptedCinderVolumes-2090501161 None] Terminate volume connection completed successfully.
Jan 25 14:14:32.780735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-436cc450-5a1f-4e06-9117-be72563c1f6c req-d8eea8c7-7dbe-4986-a4cb-06eb8f58ebb5 tempest-TestEncryptedCinderVolumes-2090501161 None] Deleting attachment ac86e218-c4a2-4732-b068-7d6584e6a031. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:14:32.782303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:32.860782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:32.861718 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d\n            Backing store flags: \n    Account information:\n        KXYTqiShLx7bdRVqK37R\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:32.862404 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-436cc450-5a1f-4e06-9117-be72563c1f6c req-d8eea8c7-7dbe-4986-a4cb-06eb8f58ebb5 tempest-TestEncryptedCinderVolumes-2090501161 None] Removing iscsi_target for Volume ID: 44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:32.863576 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:32.944240 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-44819aac-43f7-47e3-b82a-7a88a350122d -f" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:32.944720 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:32.948308 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:33.023630 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:33.024029 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:33.135366 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-436cc450-5a1f-4e06-9117-be72563c1f6c req-d8eea8c7-7dbe-4986-a4cb-06eb8f58ebb5 tempest-TestEncryptedCinderVolumes-2090501161 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:14:33.135366 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:14:33.135366 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:14:33.633104 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:34.619855 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Lock "b'cinder-44819aac-43f7-47e3-b82a-7a88a350122d-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 14:14:34.642087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:34.724507 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:34.803454 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:34.803834 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:14:34.804567 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Skipping remove_export. No iscsi_target is presently exported for volume: 44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:34.805449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:34.822496 n-d-760454-3 sudo[16548]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:34.823040 n-d-760454-3 sudo[16548]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:35.342579 n-d-760454-3 sudo[16548]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:35.344944 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d" returned: 0 in 0.539s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:35.346670 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:35.363376 n-d-760454-3 sudo[16552]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:35.363921 n-d-760454-3 sudo[16552]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:35.651880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:35.707639 n-d-760454-3 sudo[16552]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:35.709595 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d" returned: 0 in 0.363s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:35.711489 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:35.728949 n-d-760454-3 sudo[16556]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:35.729491 n-d-760454-3 sudo[16556]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:36.256631 n-d-760454-3 sudo[16556]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:36.258950 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-44819aac-43f7-47e3-b82a-7a88a350122d" returned: 0 in 0.547s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:36.260207 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Successfully deleted volume: 44819aac-43f7-47e3-b82a-7a88a350122d
Jan 25 14:14:36.291678 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-luks-1218947170 is set by the default quota flag: quota_volumes_tempest-scenario-type-luks-1218947170, it is now deprecated. Please use the default quota class for default quota.
Jan 25 14:14:36.292611 n-d-760454-3 cinder-volume[89138]: WARNING cinder.quota [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-luks-1218947170 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-luks-1218947170, it is now deprecated. Please use the default quota class for default quota.
Jan 25 14:14:36.340392 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Created reservations ['64f68e46-4b07-4498-bebf-f7182c3e820f', 'cfa22427-9111-4df0-bad2-7471c3cc21f2', '9f366cb7-2011-4bc4-a83f-fdfe00067866', 'ecd25c08-3a56-46dd-8800-ed33ba0f0963'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 14:14:36.342810 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:14:36.342810 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:14:36.342810 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:14:36.460707 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:14:36.461505 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:36.477325 n-d-760454-3 sudo[16565]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:14:36.477887 n-d-760454-3 sudo[16565]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:36.663988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:36.850275 n-d-760454-3 sudo[16565]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:36.852158 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:36.853803 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:36.871843 n-d-760454-3 sudo[16569]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:14:36.872868 n-d-760454-3 sudo[16569]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:37.387428 n-d-760454-3 sudo[16569]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:37.389856 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.536s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:37.391610 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:14:37.398119 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Deleted volume successfully.
Jan 25 14:14:37.478224 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-835d4c73-817d-4395-89a7-5bd134fc1492 tempest-TestEncryptedCinderVolumes-2090501161 None] Lock "b'cinder-44819aac-43f7-47e3-b82a-7a88a350122d-delete_volume'" released by "delete_volume" :: held 2.858s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 14:14:37.670120 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:38.675617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:39.680950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:40.694562 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:41.699376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:42.705056 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:43.710619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:44.716145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:45.721814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:46.727669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:47.239106 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:14:47.239511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:14:47.240320 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:47.259347 n-d-760454-3 sudo[16596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:14:47.260454 n-d-760454-3 sudo[16596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:47.667328 n-d-760454-3 sudo[16596]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:47.669495 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:47.671219 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:14:47.689831 n-d-760454-3 sudo[16601]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:14:47.690700 n-d-760454-3 sudo[16601]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:14:47.739563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:48.269501 n-d-760454-3 sudo[16601]: pam_unix(sudo:session): session closed for user root
Jan 25 14:14:48.271384 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:14:48.272514 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:14:48.746307 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:49.752442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:50.758762 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:51.764487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:52.770479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:53.776327 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:54.780756 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:55.787168 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:56.795730 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:57.798395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:58.803728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:14:59.809151 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:00.816906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:01.822547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:02.830520 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:03.836424 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:04.841830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:05.847410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:06.853117 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:07.859524 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:08.866043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:09.872006 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:10.878772 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:11.885534 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:12.894680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:13.939078 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:14.945765 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:15.953289 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:16.958822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:17.967867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:18.974101 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:19.979841 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:20.986973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:21.995288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:23.001931 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:24.007512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:25.012792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:26.018203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:27.024385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:28.029113 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:29.035717 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:30.042926 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:31.048951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:32.054817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:33.061388 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:34.067462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:35.073356 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:36.081907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:37.087590 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:38.093294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:39.100969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:40.106498 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:41.112454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:42.117556 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:43.123807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:44.129275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:45.135288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:46.142671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:47.148111 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:47.240711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:15:47.240711 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:15:47.241494 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:47.261067 n-d-760454-3 sudo[16982]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:15:47.261587 n-d-760454-3 sudo[16982]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:15:47.650084 n-d-760454-3 sudo[16982]: pam_unix(sudo:session): session closed for user root
Jan 25 14:15:47.652436 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:47.653842 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:47.671812 n-d-760454-3 sudo[16986]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:15:47.672388 n-d-760454-3 sudo[16986]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:15:48.155788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:48.290461 n-d-760454-3 sudo[16986]: pam_unix(sudo:session): session closed for user root
Jan 25 14:15:48.292233 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:48.293060 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:15:49.161766 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:50.167377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:50.620489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 14:15:50.624959 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 14:15:50.625514 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 14:15:50.639765 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Flow 'volume_create_manager' (2fcad22b-365e-4306-b45c-2827e1c50fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:15:50.643175 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c429a436-05d6-4788-b355-62d04b50c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:50.670742 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 14:15:50.697500 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c429a436-05d6-4788-b355-62d04b50c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T14:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2134423380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=53c888c2-90db-4571-99d3-b3eca96792fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4db7493d5b4e0a846f5d067a6154bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T14:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T14:15:51Z,user_id='13d1013180b24aa894b44b708e604c66',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:50.700138 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3321e6ff-3e2b-478d-8964-df52b26c99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:50.702489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3321e6ff-3e2b-478d-8964-df52b26c99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:50.704964 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431eb270-1bcd-4457-91cd-12471d17f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:50.707884 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431eb270-1bcd-4457-91cd-12471d17f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c888c2-90db-4571-99d3-b3eca96792fc', 'volume_name': 'volume-53c888c2-90db-4571-99d3-b3eca96792fc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:50.710342 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1370c05b-da04-4827-9198-d32497787fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:50.712688 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1370c05b-da04-4827-9198-d32497787fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:50.715090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dca0702-8453-49f6-ab39-362644d3e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:50.715937 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Volume 53c888c2-90db-4571-99d3-b3eca96792fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c888c2-90db-4571-99d3-b3eca96792fc', 'volume_size': 1}
Jan 25 14:15:50.717063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-53c888c2-90db-4571-99d3-b3eca96792fc stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:50.733894 n-d-760454-3 sudo[16992]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-53c888c2-90db-4571-99d3-b3eca96792fc stack-volumes-lvmdriver-1 -L 1g
Jan 25 14:15:50.734507 n-d-760454-3 sudo[16992]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:15:51.176652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:51.289060 n-d-760454-3 sudo[16992]: pam_unix(sudo:session): session closed for user root
Jan 25 14:15:51.291060 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-53c888c2-90db-4571-99d3-b3eca96792fc stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.574s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:51.294484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dca0702-8453-49f6-ab39-362644d3e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c888c2-90db-4571-99d3-b3eca96792fc', 'volume_size': 1}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:51.297127 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101351e4-daf6-499d-9d9f-fd407c4a5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:15:51.453802 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Volume volume-53c888c2-90db-4571-99d3-b3eca96792fc (53c888c2-90db-4571-99d3-b3eca96792fc): created successfully
Jan 25 14:15:51.456446 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101351e4-daf6-499d-9d9f-fd407c4a5963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:15:51.459864 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Flow 'volume_create_manager' (2fcad22b-365e-4306-b45c-2827e1c50fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:15:51.532937 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-5d7d89ef-3fc6-4bf9-a88e-94e7415a5748 tempest-TestMinimumBasicScenario-2024404520 None] Created volume successfully.
Jan 25 14:15:52.182800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:52.915303 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:52.931422 n-d-760454-3 sudo[17023]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:15:52.931993 n-d-760454-3 sudo[17023]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:15:53.192666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:53.282421 n-d-760454-3 sudo[17023]: pam_unix(sudo:session): session closed for user root
Jan 25 14:15:53.284601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc" returned: 0 in 0.369s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.336824 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:53.342422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.342832 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:15:53.343456 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:15:53.344332 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Creating iscsi_target for Volume ID: volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Created volume path /opt/stack/data/cinder/volumes/volume-53c888c2-90db-4571-99d3-b3eca96792fc,
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc>
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:     incominguser 44DYAf94FkNxnfVxd2F6 o4CMXYDsBW8kNSjz
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:15:53.400919 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:15:53.402211 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:53.766061 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc" returned: 0 in 0.363s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.766429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:15:53.767061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:15:53.767464 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:15:53.769194 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:53.775623 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.007s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.776016 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc\n            Backing store flags: \n    Account information:\n        44DYAf94FkNxnfVxd2F6\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:15:53.776685 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:15:53.777792 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:53.855281 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.077s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.855736 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc\n            Backing store flags: \n    Account information:\n        44DYAf94FkNxnfVxd2F6\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:15:53.857099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:15:53.938492 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.081s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:15:53.938872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc\n            Backing store flags: \n    Account information:\n        44DYAf94FkNxnfVxd2F6\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:15:53.939895 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:15:54.183202 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-02bbb27b-faf0-4f8e-8bb6-425958cb6087 req-b765e60b-faaf-4a3a-a12f-564247338e8e tempest-TestMinimumBasicScenario-2024404520 None] attachment_update completed successfully.
Jan 25 14:15:54.198950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:55.204405 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:56.209497 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:57.215080 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:58.221254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:15:59.226902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:00.232121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:01.237780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:02.243594 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:03.249398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:04.254917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:05.260558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:06.266137 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:07.273435 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:08.278431 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:09.283897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:10.289680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:11.294708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:12.299662 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:13.305341 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:14.310838 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:15.316378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:16.322432 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:17.327724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:18.333173 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:19.337991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:20.343360 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:21.348880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:22.355212 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:23.361316 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:24.366921 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:25.372513 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:26.379802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:27.385300 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:28.390890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:29.396500 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:30.401206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:31.406222 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:32.412199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:33.417641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:34.422972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:35.428259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:36.435337 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:37.441017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:38.446365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:39.451963 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:40.457646 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:41.469087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:42.470342 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:43.475995 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:44.481769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:45.487249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:46.492928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:47.241785 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:16:47.242155 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:16:47.242985 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:16:47.259913 n-d-760454-3 sudo[17102]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:16:47.260445 n-d-760454-3 sudo[17102]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:16:47.500328 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:47.608271 n-d-760454-3 sudo[17102]: pam_unix(sudo:session): session closed for user root
Jan 25 14:16:47.610081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:16:47.611214 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:16:47.627738 n-d-760454-3 sudo[17106]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:16:47.628302 n-d-760454-3 sudo[17106]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:16:48.174115 n-d-760454-3 sudo[17106]: pam_unix(sudo:session): session closed for user root
Jan 25 14:16:48.176458 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.565s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:16:48.178418 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:16:48.507241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:49.512269 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:50.518154 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:51.523700 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:52.529197 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:53.535900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:54.541621 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:55.547172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:56.553136 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:57.559046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:58.573005 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:16:59.572454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:00.578554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:01.587809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:02.593473 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:03.603243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:04.606013 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:05.611233 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:06.617510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:07.623417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:08.631077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:09.636981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:10.643248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:11.649206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:12.654784 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:13.660797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:14.666551 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:15.673423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:16.679081 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:17.684638 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:18.690234 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:19.695598 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:20.701041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:21.707797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:22.713112 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:23.718622 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:24.724792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:25.730410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:26.736630 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:27.743105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:28.748609 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:29.753910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:30.758807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:31.764495 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:32.770738 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:33.776574 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:34.782806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:35.788466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:36.794142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:37.799181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:38.805338 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:39.810777 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:40.816463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:41.822116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:42.827872 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:43.834278 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:44.839779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:45.845108 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:46.850409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:47.245876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:17:47.246203 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:17:47.247056 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:17:47.263308 n-d-760454-3 sudo[17129]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:17:47.263851 n-d-760454-3 sudo[17129]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:17:47.611382 n-d-760454-3 sudo[17129]: pam_unix(sudo:session): session closed for user root
Jan 25 14:17:47.613549 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.366s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:17:47.614828 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:17:47.630642 n-d-760454-3 sudo[17133]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:17:47.631214 n-d-760454-3 sudo[17133]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:17:47.857797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:48.156979 n-d-760454-3 sudo[17133]: pam_unix(sudo:session): session closed for user root
Jan 25 14:17:48.158758 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:17:48.159597 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:17:48.863439 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:49.869728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:50.875852 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:51.881683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:52.887707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:53.893168 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:54.898771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:55.904286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:56.911072 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:57.916178 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:58.920953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:17:59.927217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:00.932452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:01.938177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:02.943170 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:03.948462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:04.954933 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:05.961029 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:06.968387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:07.973542 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:08.979885 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:09.986545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:10.992776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:11.999213 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:12.420102 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-4fd49d0d-f855-4ee7-a3c6-027071d30907 req-8ad2af36-ea03-4749-8895-324b32b2ad71 tempest-TestMinimumBasicScenario-2024404520 None] Terminate volume connection completed successfully.
Jan 25 14:18:12.420593 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-4fd49d0d-f855-4ee7-a3c6-027071d30907 req-8ad2af36-ea03-4749-8895-324b32b2ad71 tempest-TestMinimumBasicScenario-2024404520 None] Deleting attachment ac132a27-d3da-4f86-8848-ca3c342cf2f4. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:18:12.422401 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:12.507205 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.084s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:12.507601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc\n            Backing store flags: \n    Account information:\n        44DYAf94FkNxnfVxd2F6\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:18:12.508304 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-4fd49d0d-f855-4ee7-a3c6-027071d30907 req-8ad2af36-ea03-4749-8895-324b32b2ad71 tempest-TestMinimumBasicScenario-2024404520 None] Removing iscsi_target for Volume ID: 53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:12.509572 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:12.597375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-53c888c2-90db-4571-99d3-b3eca96792fc -f" returned: 0 in 0.087s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:12.597747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:18:12.598993 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:12.681335 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.082s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:12.681763 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:18:12.787779 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-4fd49d0d-f855-4ee7-a3c6-027071d30907 req-8ad2af36-ea03-4749-8895-324b32b2ad71 tempest-TestMinimumBasicScenario-2024404520 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:18:12.787779 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:18:12.787779 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:18:13.004330 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:14.010196 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:14.364879 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Lock "b'cinder-53c888c2-90db-4571-99d3-b3eca96792fc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 14:18:14.469851 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:14.549524 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:14.549915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:18:14.550639 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Skipping remove_export. No iscsi_target is presently exported for volume: 53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:14.551530 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:14.567540 n-d-760454-3 sudo[17189]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:14.568171 n-d-760454-3 sudo[17189]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:15.022635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:15.073180 n-d-760454-3 sudo[17189]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:15.075078 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc" returned: 0 in 0.523s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:15.076190 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:15.093369 n-d-760454-3 sudo[17193]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:15.093911 n-d-760454-3 sudo[17193]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:15.451216 n-d-760454-3 sudo[17193]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:15.453378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc" returned: 0 in 0.377s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:15.455222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:15.472431 n-d-760454-3 sudo[17197]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:15.473057 n-d-760454-3 sudo[17197]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:16.010195 n-d-760454-3 sudo[17197]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:16.012431 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-53c888c2-90db-4571-99d3-b3eca96792fc" returned: 0 in 0.557s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:16.013738 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Successfully deleted volume: 53c888c2-90db-4571-99d3-b3eca96792fc
Jan 25 14:18:16.042389 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:16.107508 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Created reservations ['45fdfc34-4d52-4af0-8054-90d9ae4caf66', 'a55812a6-970b-45b4-bce0-d9752bb9b7b6', 'd3424479-789f-4520-b71c-e36ed1592272', '75e0048b-764b-47ab-aabe-59b699041b01'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 14:18:16.109823 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:18:16.109823 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:18:16.109823 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:18:16.216061 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:18:16.216811 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:16.233756 n-d-760454-3 sudo[17206]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:18:16.234319 n-d-760454-3 sudo[17206]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:16.605973 n-d-760454-3 sudo[17206]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:16.608440 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.391s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:16.610386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:16.626860 n-d-760454-3 sudo[17210]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:18:16.627382 n-d-760454-3 sudo[17210]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:17.054135 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:17.178515 n-d-760454-3 sudo[17210]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:17.180579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:17.182339 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:18:17.188876 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Deleted volume successfully.
Jan 25 14:18:17.279183 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [None req-9de93bca-7559-4e6f-9993-966fb0d07609 tempest-TestMinimumBasicScenario-2024404520 None] Lock "b'cinder-53c888c2-90db-4571-99d3-b3eca96792fc-delete_volume'" released by "delete_volume" :: held 2.914s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 14:18:18.059990 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:19.066285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:20.072875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:21.079642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:22.086264 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:23.091028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:24.096607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:25.102407 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:26.108204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:27.114082 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:28.120290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:29.125473 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:30.132907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:31.138981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:32.144675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:33.150883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:34.156882 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:35.162830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:36.168139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:37.174477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:38.179525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:39.185180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:40.190856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:41.200908 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:42.207270 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:43.214060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:44.220596 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:45.226933 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:46.233230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:47.240525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:47.246116 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:18:47.246903 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:18:47.247846 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:47.267915 n-d-760454-3 sudo[17426]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:18:47.268455 n-d-760454-3 sudo[17426]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:47.675272 n-d-760454-3 sudo[17426]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:47.678104 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:47.679618 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:18:47.700021 n-d-760454-3 sudo[17439]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:18:47.700592 n-d-760454-3 sudo[17439]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:18:48.248205 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:48.316820 n-d-760454-3 sudo[17439]: pam_unix(sudo:session): session closed for user root
Jan 25 14:18:48.319224 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:18:48.320146 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:18:49.253077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:50.260747 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:51.267727 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:52.273596 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:53.279294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:54.284736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:55.291043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:56.296779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:57.302761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:58.308266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:18:59.313625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:00.319410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:01.325243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:02.332287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:03.337799 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:04.342639 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:05.349233 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:06.354843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:07.360481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:08.366552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:09.371733 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:10.377391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:11.381913 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:12.387586 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:13.393055 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:14.399306 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:15.404679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:16.411357 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:17.416988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:18.422391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:19.427436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:20.432843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:21.438650 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:22.444046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:23.450174 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:24.455305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:25.460791 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:26.466617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:27.472336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:28.478308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:29.484005 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:30.489751 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:31.494882 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:32.500440 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:33.506235 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:34.512280 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:35.518438 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:36.524729 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:37.530391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:38.536553 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:39.542822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:40.548878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:41.555462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:42.561139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:43.566953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:44.572676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:45.577989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:46.584395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:47.243285 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:19:47.243654 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:19:47.244707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:19:47.264557 n-d-760454-3 sudo[17628]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:19:47.265683 n-d-760454-3 sudo[17628]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:19:47.591623 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:47.655233 n-d-760454-3 sudo[17628]: pam_unix(sudo:session): session closed for user root
Jan 25 14:19:47.657726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:19:47.659037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:19:47.678212 n-d-760454-3 sudo[17632]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:19:47.679338 n-d-760454-3 sudo[17632]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:19:48.294453 n-d-760454-3 sudo[17632]: pam_unix(sudo:session): session closed for user root
Jan 25 14:19:48.296961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:19:48.297930 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:19:48.598369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:49.605206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:50.612820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:51.618535 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:52.625011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:53.630282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:54.635986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:55.641810 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:56.647223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:57.652868 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:58.657897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:19:59.663931 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:00.669417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:01.675206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:02.681365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:03.687138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:04.692294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:05.698840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:06.706795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:07.713156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:08.718807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:09.723934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:10.729879 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:11.736198 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:12.741604 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:13.747503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:14.753133 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:15.758970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:16.765310 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:17.770631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:18.776800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:19.782412 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:20.787994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:21.793009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:22.798685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:23.804573 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:24.810126 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:25.815510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:26.821266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:27.829169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:28.837249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:29.843542 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:30.849294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:31.854708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:32.860257 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:33.865096 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:34.871723 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:35.877304 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:36.883197 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:37.890225 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:38.896614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:39.908242 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:40.915333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:41.921758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:42.934458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:43.940986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:44.947653 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:45.952408 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:46.956978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:47.245225 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:20:47.245623 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:20:47.246462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:20:47.264039 n-d-760454-3 sudo[17977]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:20:47.264600 n-d-760454-3 sudo[17977]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:20:47.641502 n-d-760454-3 sudo[17977]: pam_unix(sudo:session): session closed for user root
Jan 25 14:20:47.644117 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:20:47.645481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:20:47.663722 n-d-760454-3 sudo[17983]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:20:47.664497 n-d-760454-3 sudo[17983]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:20:47.965380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:48.314490 n-d-760454-3 sudo[17983]: pam_unix(sudo:session): session closed for user root
Jan 25 14:20:48.316488 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:20:48.317314 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:20:48.971203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:49.976902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:50.981715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:51.988150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:52.994109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:53.999801 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:55.004365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:56.010563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:57.015274 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:58.020768 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:20:59.026370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:00.032083 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:01.038554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:02.044441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:03.050272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:04.056690 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:05.063916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:06.071298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:07.077756 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:08.083656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:09.091340 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:10.096452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:11.102167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:12.107590 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:13.113800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:14.118673 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:15.125744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:16.131143 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:17.137545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:18.143737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:19.149854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:20.155722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:21.163417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:22.169528 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:23.175452 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:24.181337 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:25.187671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:26.195049 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:27.200953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:28.206433 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:29.219538 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:30.226009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:31.223694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:32.230206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:33.237251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:34.242669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:35.248275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:36.254192 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:37.260263 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:38.266097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:39.271002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:40.276776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:41.282295 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:42.289040 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:43.294968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:44.300833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:45.306655 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:46.312987 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:47.244479 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:21:47.244860 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:21:47.245662 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:21:47.262169 n-d-760454-3 sudo[18075]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:21:47.262779 n-d-760454-3 sudo[18075]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:21:47.322376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:47.638063 n-d-760454-3 sudo[18075]: pam_unix(sudo:session): session closed for user root
Jan 25 14:21:47.639848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.394s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:21:47.641027 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:21:47.657428 n-d-760454-3 sudo[18079]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:21:47.658019 n-d-760454-3 sudo[18079]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:21:48.248029 n-d-760454-3 sudo[18079]: pam_unix(sudo:session): session closed for user root
Jan 25 14:21:48.250313 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:21:48.251203 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:21:48.328545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:49.334547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:50.340079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:51.345364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:52.353164 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:53.359063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:54.364464 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:55.371102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:56.377467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:57.383299 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:58.391069 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:21:59.397463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:00.403521 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:01.409463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:02.415508 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:03.423782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:04.429807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:05.435525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:06.441229 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:07.447789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:08.453476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:09.459543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:10.465199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:11.470880 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:12.476981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:13.482726 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:14.487685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:15.493462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:16.499867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:17.504885 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:18.511685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:19.517126 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:20.523145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:21.528743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:22.534205 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:23.540870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:24.546579 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:25.551934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:26.557410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:27.562849 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:28.568296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:29.573249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:30.579097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:31.585039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:32.590825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:33.596511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:34.603961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:35.609854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:36.615869 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:37.621465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:38.627319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:39.633258 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:40.639138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:41.644881 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:42.650569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:43.656709 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:44.664395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:45.669676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:46.677024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:47.250182 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:22:47.250591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:22:47.251411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:22:47.268692 n-d-760454-3 sudo[18112]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:22:47.269246 n-d-760454-3 sudo[18112]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:22:47.649220 n-d-760454-3 sudo[18112]: pam_unix(sudo:session): session closed for user root
Jan 25 14:22:47.651391 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:22:47.652717 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:22:47.669669 n-d-760454-3 sudo[18117]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:22:47.670294 n-d-760454-3 sudo[18117]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:22:47.684989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:48.266731 n-d-760454-3 sudo[18117]: pam_unix(sudo:session): session closed for user root
Jan 25 14:22:48.272703 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:22:48.274426 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:22:48.690917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:49.696032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:50.701847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:51.707762 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:52.714293 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:53.719904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:54.725602 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:55.731047 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:56.736152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:57.742502 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:58.747034 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:22:59.753394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:00.759244 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:01.765024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:02.769729 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:03.775811 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:04.781388 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:05.786409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:06.792318 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:07.797619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:08.802790 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:09.808418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:10.814045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:11.820804 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:12.827394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:13.833036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:14.838614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:15.843799 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:16.849639 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:17.854791 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:18.859790 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:19.866317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:20.872018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:21.877642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:22.883988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:23.890213 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:24.896051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:25.905119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:26.912073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:27.917629 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:28.923528 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:29.929851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:30.935662 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:31.941472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:32.946389 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:33.952994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:34.960187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:35.965885 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:36.970459 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:37.976336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:38.982255 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:39.988568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:40.997588 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:42.003968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:43.012567 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:44.018326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:45.024411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:46.030836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:47.036104 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:47.250193 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:23:47.250647 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:23:47.251431 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:23:47.269883 n-d-760454-3 sudo[18206]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:23:47.271045 n-d-760454-3 sudo[18206]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:23:47.682273 n-d-760454-3 sudo[18206]: pam_unix(sudo:session): session closed for user root
Jan 25 14:23:47.684343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:23:47.685861 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:23:47.704672 n-d-760454-3 sudo[18210]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:23:47.705850 n-d-760454-3 sudo[18210]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:23:48.044566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:48.348265 n-d-760454-3 sudo[18210]: pam_unix(sudo:session): session closed for user root
Jan 25 14:23:48.350365 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:23:48.352054 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:23:49.051121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:50.057314 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:51.062845 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:52.070279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:53.075669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:54.081550 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:55.086733 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:56.093851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:57.101046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:58.106746 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:23:59.112347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:00.119092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:01.126579 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:02.132560 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:03.138364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:04.144239 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:05.149890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:06.155245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:07.160077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:08.165659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:09.171294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:10.177662 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:11.183206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:12.189488 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:13.195939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:14.204116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:15.209825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:16.216865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:17.223066 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:18.228512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:19.234342 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:20.239980 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:21.245343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:22.251131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:23.256807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:24.262357 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:25.268024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:26.274051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:27.280563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:28.288773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:29.294948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:30.301059 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:31.306889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:32.312679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:33.317736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:34.323999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:35.329761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:36.334833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:37.340555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:38.345472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:39.351208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:40.357184 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:41.362467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:42.368157 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:43.373947 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:44.379573 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:45.385402 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:46.391813 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:47.250875 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:24:47.251200 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:24:47.252635 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:24:47.269744 n-d-760454-3 sudo[18566]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:24:47.270323 n-d-760454-3 sudo[18566]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:24:47.399851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:47.657343 n-d-760454-3 sudo[18566]: pam_unix(sudo:session): session closed for user root
Jan 25 14:24:47.659501 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.407s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:24:47.662728 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:24:47.678979 n-d-760454-3 sudo[18570]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:24:47.679514 n-d-760454-3 sudo[18570]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:24:48.290064 n-d-760454-3 sudo[18570]: pam_unix(sudo:session): session closed for user root
Jan 25 14:24:48.292282 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:24:48.293223 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:24:48.405688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:49.412068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:50.417403 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:51.422772 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:52.428636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:53.434364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:54.440392 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:55.446009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:56.452068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:57.458369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:58.463930 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:24:59.469648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:00.475241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:01.481068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:02.486308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:03.491081 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:04.496252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:05.501990 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:06.508137 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:07.513147 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:08.519423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:09.525168 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:10.530827 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:11.536683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:12.542430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:13.547426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:14.553161 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:15.558068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:16.563724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:17.569230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:18.574784 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:19.580418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:20.586350 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:21.591794 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:22.596614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:23.602462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:24.608041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:25.613978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:26.619920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:27.625144 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:28.630720 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:29.637215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:30.642836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:31.648655 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:32.653260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:33.659381 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:34.665645 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:35.671401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:36.677133 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:37.682920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:38.689383 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:39.694182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:40.699096 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:41.705135 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:42.710738 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:43.716509 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:44.722888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:45.730049 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:46.736317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:47.251749 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:25:47.256090 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:25:47.256090 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:25:47.275695 n-d-760454-3 sudo[18608]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:25:47.276993 n-d-760454-3 sudo[18608]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:25:47.665221 n-d-760454-3 sudo[18608]: pam_unix(sudo:session): session closed for user root
Jan 25 14:25:47.667315 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:25:47.668640 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:25:47.685763 n-d-760454-3 sudo[18612]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:25:47.686338 n-d-760454-3 sudo[18612]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:25:47.743214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:48.301496 n-d-760454-3 sudo[18612]: pam_unix(sudo:session): session closed for user root
Jan 25 14:25:48.303631 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:25:48.304492 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:25:48.748789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:49.755030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:50.761828 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:51.768602 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:52.773938 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:53.779576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:54.785376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:55.791822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:56.797613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:57.802854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:58.808472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:25:59.814169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:00.819735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:01.825707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:02.831761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:03.837263 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:04.843368 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:05.849400 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:06.854698 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:07.860381 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:08.865955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:09.871668 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:10.877668 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:11.883269 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:12.888054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:13.894044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:14.899798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:15.905998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:16.911552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:17.917285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:18.923507 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:19.929847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:20.936333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:21.941634 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:22.947184 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:23.952489 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:24.958058 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:25.965851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:26.971735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:27.978289 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:28.983816 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:29.989614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:30.995253 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:32.001672 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:33.007175 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:34.012260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:35.017889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:36.023182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:37.028060 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:38.033943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:39.039984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:40.045387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:41.050917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:42.056132 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:43.061777 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:44.067570 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:45.074134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:46.080774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:47.086421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:47.252615 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:26:47.252908 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:26:47.254006 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:26:47.271772 n-d-760454-3 sudo[18709]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:26:47.272313 n-d-760454-3 sudo[18709]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:26:47.670058 n-d-760454-3 sudo[18709]: pam_unix(sudo:session): session closed for user root
Jan 25 14:26:47.672336 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:26:47.673625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:26:47.689937 n-d-760454-3 sudo[18720]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:26:47.690500 n-d-760454-3 sudo[18720]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:26:48.100516 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:48.378113 n-d-760454-3 sudo[18720]: pam_unix(sudo:session): session closed for user root
Jan 25 14:26:48.379872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:26:48.381211 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:26:49.106265 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:50.112980 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:51.118505 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:52.134623 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:53.141956 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:54.150737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:55.156376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:56.161476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:57.167449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:58.173107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:26:59.177829 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:00.183601 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:01.188504 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:02.194016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:03.199325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:04.204419 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:05.209674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:06.215470 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:07.221853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:08.227026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:09.235322 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:10.240416 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:11.248240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:12.253073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:13.258934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:14.264856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:15.271248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:16.277563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:17.283243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:18.288848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:19.294742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:20.299502 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:21.306309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:22.313255 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:23.319533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:24.325312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:25.331846 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:26.338116 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:27.344367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:28.350705 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:29.356349 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:30.361976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:31.367686 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:32.374357 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:33.380044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:34.385320 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:35.390755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:36.396520 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:37.401437 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:38.407005 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:39.411947 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:40.417914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:41.424070 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:42.429250 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:43.434079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:44.440222 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:45.445291 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:46.451614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:47.265091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:27:47.265091 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:27:47.265091 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:27:47.276586 n-d-760454-3 sudo[19066]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:27:47.277214 n-d-760454-3 sudo[19066]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:27:47.459516 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:47.652378 n-d-760454-3 sudo[19066]: pam_unix(sudo:session): session closed for user root
Jan 25 14:27:47.654818 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:27:47.655976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:27:47.672890 n-d-760454-3 sudo[19070]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:27:47.673460 n-d-760454-3 sudo[19070]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:27:48.290443 n-d-760454-3 sudo[19070]: pam_unix(sudo:session): session closed for user root
Jan 25 14:27:48.292733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:27:48.293764 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:27:48.465845 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:49.471758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:50.477072 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:51.481784 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:52.487460 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:53.492478 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:54.498358 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:55.503931 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:56.509595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:57.515740 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:58.521792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:27:59.527547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:00.533618 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:01.538818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:02.544675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:03.550489 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:04.556093 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:05.561450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:06.566908 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:07.572590 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:08.578313 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:09.584148 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:10.589701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:11.595812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:12.601351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:13.607953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:14.613100 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:15.618019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:16.623853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:17.629365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:18.634636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:19.640373 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:20.645431 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:21.650503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:22.656930 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:23.663449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:24.670467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:25.675705 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:26.681065 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:27.686657 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:28.692169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:29.697606 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:30.703385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:31.709484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:32.715272 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:33.721219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:34.726985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:35.732568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:36.738466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:37.743791 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:38.751347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:39.756515 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:40.763352 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:41.769249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:42.775009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:43.780324 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:44.785533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:45.791831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:46.797254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:47.255770 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:28:47.256182 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:28:47.257054 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:28:47.274499 n-d-760454-3 sudo[19094]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:28:47.275068 n-d-760454-3 sudo[19094]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:28:47.659591 n-d-760454-3 sudo[19094]: pam_unix(sudo:session): session closed for user root
Jan 25 14:28:47.661769 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:28:47.663009 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:28:47.679966 n-d-760454-3 sudo[19098]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:28:47.680558 n-d-760454-3 sudo[19098]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:28:47.804347 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:48.259581 n-d-760454-3 sudo[19098]: pam_unix(sudo:session): session closed for user root
Jan 25 14:28:48.262081 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:28:48.266318 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:28:48.810817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:49.817121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:50.822012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:51.828113 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:52.833769 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:53.840064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:54.845555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:55.851386 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:56.856697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:57.862429 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:58.868173 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:28:59.874174 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:00.879626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:01.886317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:02.892140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:03.897813 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:04.903707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:05.910134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:06.915878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:07.922961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:08.928771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:09.934364 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:10.939888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:11.945259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:12.951567 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:13.957314 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:14.963587 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:15.969958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:16.974568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:17.980205 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:18.985787 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:19.992285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:20.998527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:22.005315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:23.011933 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:24.017694 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:25.024015 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:26.031110 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:27.037534 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:28.044218 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:29.049838 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:30.055975 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:31.061082 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:32.067150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:33.072976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:34.077725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:35.083337 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:36.089727 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:37.095329 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:38.102296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:39.108098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:40.114844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:41.120146 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:42.125231 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:43.130754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:44.136397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:45.141290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:46.152937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:47.159687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:47.258733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:29:47.259134 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:29:47.259947 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:29:47.277192 n-d-760454-3 sudo[19166]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:29:47.277762 n-d-760454-3 sudo[19166]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:29:47.676851 n-d-760454-3 sudo[19166]: pam_unix(sudo:session): session closed for user root
Jan 25 14:29:47.678992 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:29:47.680524 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:29:47.699106 n-d-760454-3 sudo[19170]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:29:47.699718 n-d-760454-3 sudo[19170]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:29:48.168151 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:48.336686 n-d-760454-3 sudo[19170]: pam_unix(sudo:session): session closed for user root
Jan 25 14:29:48.339449 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:29:48.341088 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:29:49.173298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:50.178878 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:51.184656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:52.189749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:53.196480 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:54.202262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:55.208107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:56.213754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:57.219181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:58.225032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:29:59.231177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:00.237044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:01.249419 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:02.257394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:03.262240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:04.267745 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:05.273815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:06.282581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:07.290066 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:08.295846 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:09.301636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:10.307275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:11.313405 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:12.324143 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:13.329569 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:14.336707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:15.342615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:16.348323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:17.355008 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:18.360677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:19.366885 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:20.372552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:21.377770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:22.383296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:23.390359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:24.396640 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:25.403063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:26.409516 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:27.415128 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:28.420682 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:29.426207 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:30.432774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:31.438503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:32.443998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:33.449641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:34.455012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:35.460674 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:36.466690 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:37.472555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:38.478320 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:39.483862 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:40.489976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:41.495530 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:42.501249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:43.507918 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:44.513548 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:45.519310 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:46.525547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:47.260626 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:30:47.260986 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:30:47.261878 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:30:47.278655 n-d-760454-3 sudo[19550]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:30:47.279267 n-d-760454-3 sudo[19550]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:30:47.533430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:47.647539 n-d-760454-3 sudo[19550]: pam_unix(sudo:session): session closed for user root
Jan 25 14:30:47.649900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:30:47.650676 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:30:47.666819 n-d-760454-3 sudo[19554]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:30:47.667361 n-d-760454-3 sudo[19554]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:30:48.247014 n-d-760454-3 sudo[19554]: pam_unix(sudo:session): session closed for user root
Jan 25 14:30:48.249231 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:30:48.250143 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:30:48.540354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:49.546017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:50.552153 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:51.557663 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:52.563386 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:53.569571 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:54.575268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:55.580556 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:56.585640 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:57.590456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:58.595476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:30:59.600970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:00.606731 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:01.612142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:02.618217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:03.623746 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:04.629099 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:05.635202 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:06.640316 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:07.647312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:08.652902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:09.658374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:10.664502 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:11.669969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:12.675635 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:13.681344 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:14.687117 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:15.692992 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:16.698561 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:17.704365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:18.710442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:19.715797 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:20.721130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:21.727257 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:22.732875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:23.738367 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:24.743793 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:25.748615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:26.754236 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:27.759860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:28.765683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:29.772256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:30.777739 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:31.784308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:32.790487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:33.796430 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:34.802989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:35.808378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:36.813948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:37.820365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:38.825814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:39.831484 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:40.838943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:41.844472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:42.850359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:43.855833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:44.861493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:45.866903 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:46.875988 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:47.257455 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:31:47.257858 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:31:47.258660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:31:47.275740 n-d-760454-3 sudo[19596]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:31:47.276281 n-d-760454-3 sudo[19596]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:31:47.658956 n-d-760454-3 sudo[19596]: pam_unix(sudo:session): session closed for user root
Jan 25 14:31:47.661386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:31:47.662652 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:31:47.679796 n-d-760454-3 sudo[19603]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:31:47.680598 n-d-760454-3 sudo[19603]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:31:47.885661 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:48.224279 n-d-760454-3 sudo[19603]: pam_unix(sudo:session): session closed for user root
Jan 25 14:31:48.226132 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.563s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:31:48.226929 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:31:48.891558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:49.897917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:50.903890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:51.912717 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:52.919692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:53.925163 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:54.930541 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:55.937056 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:56.944109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:57.949422 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:58.954855 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:31:59.961472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:00.968871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:01.974463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:02.980166 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:03.986353 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:04.992296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:05.997387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:07.002555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:08.008512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:09.014383 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:10.020025 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:11.030190 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:12.039354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:13.046031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:14.052211 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:15.063625 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:16.070854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:17.077476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:18.086734 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:19.093270 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:20.099461 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:21.105283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:22.114491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:23.120888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:24.126968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:25.132691 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:26.138156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:27.144232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:28.149782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:29.156996 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:30.164628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:31.169881 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:32.175281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:33.180975 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:34.186995 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:35.193410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:36.199471 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:37.206636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:38.211758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:39.217477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:40.223276 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:41.229027 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:42.234588 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:43.240915 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:44.247435 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:45.252889 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:46.258499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:47.254442 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:32:47.254840 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:32:47.255649 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:32:47.272906 n-d-760454-3 sudo[20259]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:32:47.273523 n-d-760454-3 sudo[20259]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:32:47.274408 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:47.653899 n-d-760454-3 sudo[20259]: pam_unix(sudo:session): session closed for user root
Jan 25 14:32:47.655761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.400s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:32:47.656948 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:32:47.675058 n-d-760454-3 sudo[20263]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:32:47.675629 n-d-760454-3 sudo[20263]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:32:48.244167 n-d-760454-3 sudo[20263]: pam_unix(sudo:session): session closed for user root
Jan 25 14:32:48.246393 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:32:48.247248 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:32:48.281034 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:49.286736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:50.292806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:51.299238 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:52.304487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:53.309764 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:54.315840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:55.321701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:56.328180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:57.333928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:58.340223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:32:59.346103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:00.351942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:01.358369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:02.363972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:03.370476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:04.376022 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:05.381621 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:06.388021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:07.394303 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:08.399761 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:09.405554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:10.410966 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:11.416054 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:12.422307 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:13.427397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:14.433088 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:15.438782 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:16.444591 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:17.449894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:18.456450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:19.461600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:20.467589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:21.473041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:22.478714 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:23.484631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:24.490468 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:25.496036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:26.502689 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:27.508203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:28.513552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:29.518973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:30.524267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:31.530351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:32.536008 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:33.541026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:34.546837 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:35.552288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:36.557110 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:37.562891 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:38.567951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:39.573682 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:40.579423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:41.585043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:42.590499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:43.596062 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:44.601434 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:45.606321 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:46.612506 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:47.254174 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:33:47.254559 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:33:47.255422 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:33:47.272356 n-d-760454-3 sudo[20287]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:33:47.272928 n-d-760454-3 sudo[20287]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:33:47.619727 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:47.655598 n-d-760454-3 sudo[20287]: pam_unix(sudo:session): session closed for user root
Jan 25 14:33:47.657484 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:33:47.659243 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:33:47.676839 n-d-760454-3 sudo[20293]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:33:47.677427 n-d-760454-3 sudo[20293]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:33:48.162440 n-d-760454-3 sudo[20293]: pam_unix(sudo:session): session closed for user root
Jan 25 14:33:48.164625 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:33:48.165451 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:33:48.626561 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:49.632790 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:50.638333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:51.643934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:52.649483 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:53.655121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:54.660865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:55.665558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:56.670652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:57.676143 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:58.681208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:33:59.686722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:00.692754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:01.698467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:02.704679 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:03.710814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:04.716340 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:05.721585 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:06.727315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:07.732850 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:08.738555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:09.744261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:10.749800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:11.756197 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:12.761939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:13.767659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:14.773839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:15.778839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:16.785331 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:17.791259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:18.797385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:19.803335 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:20.809195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:21.815610 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:22.821035 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:23.827444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:24.832443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:25.837589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:26.843260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:27.848628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:28.854316 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:29.859359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:30.864742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:31.870333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:32.875924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:33.881561 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:34.887859 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:35.894478 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:36.900652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:37.906240 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:38.911815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:39.917122 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:40.922830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:41.928383 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:42.933984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:43.939262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:44.945075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:45.950085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:46.956863 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:47.253288 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:34:47.253617 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:34:47.254440 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:34:47.272820 n-d-760454-3 sudo[20312]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:34:47.273473 n-d-760454-3 sudo[20312]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:34:47.638258 n-d-760454-3 sudo[20312]: pam_unix(sudo:session): session closed for user root
Jan 25 14:34:47.640462 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:34:47.641728 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:34:47.657678 n-d-760454-3 sudo[20316]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:34:47.658289 n-d-760454-3 sudo[20316]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:34:47.964188 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:48.169152 n-d-760454-3 sudo[20316]: pam_unix(sudo:session): session closed for user root
Jan 25 14:34:48.171054 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.529s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:34:48.171867 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:34:48.970189 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:49.975939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:50.981551 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:51.987222 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:52.992894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:53.998580 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:55.004906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:56.010375 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:57.016059 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:58.021804 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:34:59.027308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:00.032913 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:01.038662 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:02.044692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:03.050253 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:04.056044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:05.061776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:06.067338 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:07.072773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:08.078951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:09.084809 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:10.090688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:11.096279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:12.101862 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:13.107680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:14.113716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:15.119312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:16.125540 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:17.131251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:18.137378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:19.142463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:20.148102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:21.153300 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:22.159369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:23.165044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:24.170846 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:25.176479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:26.182804 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:27.189038 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:28.194211 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:29.200290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:30.205631 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:31.211853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:32.217865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:33.224722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:34.230890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:35.237576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:36.247203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:37.253666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:38.259093 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:39.265607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:40.271151 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:41.277009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:42.282886 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:43.288331 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:44.292882 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:45.298724 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:46.303382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:47.259233 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:35:47.259633 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:35:47.260425 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:35:47.277231 n-d-760454-3 sudo[20332]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:35:47.277860 n-d-760454-3 sudo[20332]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:35:47.310854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:47.682803 n-d-760454-3 sudo[20332]: pam_unix(sudo:session): session closed for user root
Jan 25 14:35:47.684570 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:35:47.685903 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:35:47.703870 n-d-760454-3 sudo[20336]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:35:47.704416 n-d-760454-3 sudo[20336]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:35:48.263255 n-d-760454-3 sudo[20336]: pam_unix(sudo:session): session closed for user root
Jan 25 14:35:48.266164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:35:48.268808 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:35:48.318179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:49.324804 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:50.330954 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:51.336490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:52.342103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:53.349134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:54.357007 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:55.363854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:56.370547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:57.376867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:58.382686 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:35:59.388302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:00.393391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:01.398668 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:02.403354 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:03.409697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:04.415260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:05.421718 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:06.428548 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:07.434795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:08.440245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:09.445907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:10.451428 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:11.457456 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:12.463104 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:13.468877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:14.474425 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:15.480125 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:16.485791 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:17.491411 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:18.496984 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:19.502722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:20.508773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:21.514391 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:22.519968 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:23.525821 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:24.531378 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:25.537721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:26.543718 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:27.549283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:28.554981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:29.561227 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:30.566954 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:31.572426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:32.577820 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:33.583520 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:34.588851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:35.593950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:36.599982 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:37.605517 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:38.610897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:39.616490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:40.622701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:41.629033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:42.635642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:43.641511 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:44.647714 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:45.652860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:46.658612 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:47.261771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:36:47.262087 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:36:47.262900 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:36:47.279639 n-d-760454-3 sudo[20353]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:36:47.280220 n-d-760454-3 sudo[20353]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:36:47.666043 n-d-760454-3 sudo[20353]: pam_unix(sudo:session): session closed for user root
Jan 25 14:36:47.666683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:47.667825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.405s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:36:47.668950 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:36:47.686176 n-d-760454-3 sudo[20357]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:36:47.686726 n-d-760454-3 sudo[20357]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:36:48.301885 n-d-760454-3 sudo[20357]: pam_unix(sudo:session): session closed for user root
Jan 25 14:36:48.304825 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:36:48.305693 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:36:48.675256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:49.680949 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:50.685942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:51.692830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:52.698617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:53.704555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:54.711491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:55.717480 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:56.723787 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:57.729493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:58.735036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:36:59.741021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:00.746853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:01.753152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:02.758760 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:03.766091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:04.771969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:05.777317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:06.782914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:07.788353 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:08.795066 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:09.800312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:10.805320 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:11.811221 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:12.817072 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:13.822475 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:14.828000 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:15.833536 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:16.839477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:17.845589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:18.850816 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:19.857033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:20.865128 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:21.870939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:22.877388 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:23.883897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:24.889239 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:25.894649 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:26.900801 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:27.906792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:28.912517 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:29.918986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:30.924554 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:31.930124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:32.935681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:33.940927 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:34.946728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:35.952416 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:36.957890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:37.963479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:38.969201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:39.974840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:40.980758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:41.986358 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:42.992139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:43.997224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:45.003911 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:46.009574 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:47.015490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:47.263651 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:37:47.264036 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:37:47.264915 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:37:47.281801 n-d-760454-3 sudo[20379]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:37:47.282369 n-d-760454-3 sudo[20379]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:37:47.667361 n-d-760454-3 sudo[20379]: pam_unix(sudo:session): session closed for user root
Jan 25 14:37:47.669500 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:37:47.670990 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:37:47.687213 n-d-760454-3 sudo[20383]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:37:47.687827 n-d-760454-3 sudo[20383]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:37:48.023350 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:48.293018 n-d-760454-3 sudo[20383]: pam_unix(sudo:session): session closed for user root
Jan 25 14:37:48.295192 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:37:48.295990 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:37:49.028819 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:50.034563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:51.039491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:52.045124 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:53.051499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:54.056773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:55.062399 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:56.068118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:57.073265 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:58.079524 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:37:59.086108 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:00.091896 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:01.098618 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:02.104708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:03.109300 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:04.114163 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:04.561083 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['n-d-760454-3@lvmdriver-1#lvmdriver-1'], 'hosts': ['n-d-760454-3@lvmdriver-1#lvmdriver-1']} {{(pid=89244) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1263}}
Jan 25 14:38:04.565565 n-d-760454-3 cinder-volume[89138]: WARNING stevedore.named [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jan 25 14:38:04.566123 n-d-760454-3 cinder-volume[89138]: WARNING castellan.key_manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jan 25 14:38:04.580129 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Flow 'volume_create_manager' (8eb0b55f-9d9d-40f3-8ff8-bc69179ef7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:38:04.583511 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd282c4b-58ac-4d79-9706-82dd7300b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:04.608669 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_db.sqlalchemy.engines [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=89244) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
Jan 25 14:38:04.636735 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd282c4b-58ac-4d79-9706-82dd7300b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2021-01-25T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1823964993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='n-d-760454-3@lvmdriver-1#lvmdriver-1',id=1c635e62-daf0-4fd9-af1a-45d9e3de5034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ddd9cce98a4ebb88395a660b2c5f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-01-25T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2021-01-25T14:38:04Z,user_id='d43751d6af484b938f7feedc2d90a850',volume_attachment=<?>,volume_type=VolumeType(abff4454-a39c-478f-ac30-d3a463f89de6),volume_type_id=abff4454-a39c-478f-ac30-d3a463f89de6)' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:04.639388 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2898ac5b-ae8c-4072-bfbd-4a699a72ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:04.641677 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2898ac5b-ae8c-4072-bfbd-4a699a72ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:04.644159 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d986e54-e4ef-46d0-8a1c-72ea59cdace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:04.737484 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d986e54-e4ef-46d0-8a1c-72ea59cdace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c635e62-daf0-4fd9-af1a-45d9e3de5034', 'volume_name': 'volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1da358>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:04.739889 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb95dc6-f157-470f-b51b-d7effbe3e8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:04.742229 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb95dc6-f157-470f-b51b-d7effbe3e8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:04.745121 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d751c4-b02e-4f14-b08d-b293e15e536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:04.745992 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Volume 1c635e62-daf0-4fd9-af1a-45d9e3de5034: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1da358>}
Jan 25 14:38:04.746710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Cloning 1c635e62-daf0-4fd9-af1a-45d9e3de5034 from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5  at location (None, None). {{(pid=89244) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:976}}
Jan 25 14:38:05.138464 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:06.144016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:07.149092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:08.154142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:09.159332 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:10.164844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:11.169514 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:12.174951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:13.179830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:14.887736 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1, size 616.00 MB, duration 10.14 sec {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:529}}
Jan 25 14:38:14.888340 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Image download 616.00 MB at 60.75 MB/s
Jan 25 14:38:14.898234 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:14.938872 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:15.029785 n-d-760454-3 sudo[20418]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1
Jan 25 14:38:15.030460 n-d-760454-3 sudo[20418]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:15.643398 n-d-760454-3 sudo[20418]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:15.645761 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1" returned: 0 in 0.709s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:15.646615 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 is fetched for user d43751d6af484b938f7feedc2d90a850. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1005}}
Jan 25 14:38:15.765222 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:15.860510 n-d-760454-3 sudo[20422]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1
Jan 25 14:38:15.861183 n-d-760454-3 sudo[20422]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:15.906473 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:16.202954 n-d-760454-3 sudo[20422]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:16.204875 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1" returned: 0 in 0.440s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:16.206720 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 stack-volumes-lvmdriver-1 -L 1g {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:16.224436 n-d-760454-3 sudo[20426]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 stack-volumes-lvmdriver-1 -L 1g
Jan 25 14:38:16.225036 n-d-760454-3 sudo[20426]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:16.778256 n-d-760454-3 sudo[20426]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:16.780579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -n volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 stack-volumes-lvmdriver-1 -L 1g" returned: 0 in 0.573s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:16.873445 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Attempting download of 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 1c635e62-daf0-4fd9-af1a-45d9e3de5034. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1125}}
Jan 25 14:38:16.911404 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:16.918670 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxx47s953 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:17.013210 n-d-760454-3 sudo[20457]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxx47s953
Jan 25 14:38:17.013828 n-d-760454-3 sudo[20457]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:17.368082 n-d-760454-3 sudo[20457]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:17.373708 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpxx47s953" returned: 0 in 0.453s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:17.375557 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:17.478283 n-d-760454-3 sudo[20460]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1
Jan 25 14:38:17.478826 n-d-760454-3 sudo[20460]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:17.820124 n-d-760454-3 sudo[20460]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:17.822456 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1" returned: 0 in 0.447s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:17.823720 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] 8f7c7cdd-a5ad-4181-a528-c12e769851c5 was vhdx, converting to raw {{(pid=89244) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:722}}
Jan 25 14:38:17.824797 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034 oflag=direct {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:17.840989 n-d-760454-3 sudo[20464]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034 oflag=direct
Jan 25 14:38:17.841660 n-d-760454-3 sudo[20464]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:17.918871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:18.187428 n-d-760454-3 sudo[20464]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:18.189397 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 of=/dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034 oflag=direct" returned: 0 in 0.365s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:18.190697 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:18.208085 n-d-760454-3 sudo[20474]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034
Jan 25 14:38:18.208659 n-d-760454-3 sudo[20474]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:18.927172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:19.932836 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:20.938688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:21.944572 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:22.951042 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:23.955975 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:24.961800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:25.967216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:26.973512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:27.979246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:28.986092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:29.991778 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:30.997140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:31.613525 n-d-760454-3 sudo[20474]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:31.615463 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f vhdx /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 /dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034" returned: 0 in 13.425s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:31.616656 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): /usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:31.713070 n-d-760454-3 sudo[20504]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1
Jan 25 14:38:31.713613 n-d-760454-3 sudo[20504]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:32.005110 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:32.065662 n-d-760454-3 sudo[20504]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:32.068382 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] CMD "/usr/bin/python3.6 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1" returned: 0 in 0.451s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:32.069591 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Image conversion details: src /opt/stack/data/cinder/conversion/tmpzud77eten-d-760454-3@lvmdriver-1, size 700.00 MB, duration 13.43 sec, destination /dev/mapper/stack--volumes--lvmdriver--1-volume--1c635e62--daf0--4fd9--af1a--45d9e3de5034 {{(pid=89244) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:384}}
Jan 25 14:38:32.070059 n-d-760454-3 cinder-volume[89138]: INFO cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Converted 700.00 MB image at 52.14 MB/s
Jan 25 14:38:32.070727 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Downloaded image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 ((None, None)) to volume 1c635e62-daf0-4fd9-af1a-45d9e3de5034 successfully. {{(pid=89244) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1165}}
Jan 25 14:38:32.184416 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.image.image_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Temporary image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 for user d43751d6af484b938f7feedc2d90a850 is deleted. {{(pid=89244) fetch /opt/stack/cinder/cinder/image/image_utils.py:1009}}
Jan 25 14:38:32.185129 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.volume_utils [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Marking volume 1c635e62-daf0-4fd9-af1a-45d9e3de5034 as bootable. {{(pid=89244) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1078}}
Jan 25 14:38:32.216526 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Copying metadata from image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 to 1c635e62-daf0-4fd9-af1a-45d9e3de5034. {{(pid=89244) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Jan 25 14:38:32.217073 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Creating volume glance metadata for volume 1c635e62-daf0-4fd9-af1a-45d9e3de5034 backed by image 8f7c7cdd-a5ad-4181-a528-c12e769851c5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=89244) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:654}}
Jan 25 14:38:32.401444 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d751c4-b02e-4f14-b08d-b293e15e536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034', 'volume_size': 1, 'image_id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fcc8d77483444b80b18999bd8ef05eea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '8f7c7cdd-a5ad-4181-a528-c12e769851c5', 'created_at': datetime.datetime(2021, 1, 25, 12, 31, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 1, 25, 12, 32, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f7c7cdd-a5ad-4181-a528-c12e769851c5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0e8c1da358>}' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:32.404638 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9ef8dd-d4d2-4383-95e0-98156f71a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:192}}
Jan 25 14:38:32.455900 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.flows.manager.create_volume [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Volume volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 (1c635e62-daf0-4fd9-af1a-45d9e3de5034): created successfully
Jan 25 14:38:32.457977 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9ef8dd-d4d2-4383-95e0-98156f71a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89244) _task_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:181}}
Jan 25 14:38:32.461256 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Flow 'volume_create_manager' (8eb0b55f-9d9d-40f3-8ff8-bc69179ef7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89244) _flow_receiver /usr/local/lib/python3.6/dist-packages/taskflow/listeners/logging.py:143}}
Jan 25 14:38:32.513457 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [None req-b0673018-7f14-42bf-b090-f8dec3615476 tempest-TestShelveInstance-1736033758 None] Created volume successfully.
Jan 25 14:38:33.010374 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:34.015680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:35.021577 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:36.027320 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:37.033169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:38.038808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:39.044418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:40.050131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:40.263105 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:40.279596 n-d-760454-3 sudo[20510]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:38:40.280137 n-d-760454-3 sudo[20510]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:40.634045 n-d-760454-3 sudo[20510]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:40.636961 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.373s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:40.699597 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:40.706852 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.010s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:40.707949 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:38:40.708654 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Targets prior to update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:38:40.709710 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Creating iscsi_target for Volume ID: volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Created volume path /opt/stack/data/cinder/volumes/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034,
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034>
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:     incominguser UQytHanxCpxeEfJjcEW4 A3gQKkj6P7n5Vu6P
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:38:40.758497 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:38:40.760429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:41.057033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:41.142707 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.382s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:41.143086 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:38:41.143725 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:38:41.144881 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:38:41.146411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:41.152307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:41.153739 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:38:41.153739 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Targets after update:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:38:41.154772 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:41.237103 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.082s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:41.237584 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:38:41.239347 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:41.329272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:41.329272 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:38:41.329272 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:38:41.810750 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-d1cb82d3-8442-41b5-9f0d-050f2d586304 req-55feac8a-ad22-440d-b6f7-bf3217990297 tempest-TestShelveInstance-1736033758 None] attachment_update completed successfully.
Jan 25 14:38:42.063204 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:43.069486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:44.076176 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:45.083774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:46.089171 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:47.095281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:47.264073 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:38:47.264472 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:38:47.265787 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:47.282827 n-d-760454-3 sudo[20578]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:38:47.283368 n-d-760454-3 sudo[20578]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:47.635102 n-d-760454-3 sudo[20578]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:47.637216 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.371s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:47.638451 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:38:47.655252 n-d-760454-3 sudo[20582]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:38:47.656439 n-d-760454-3 sudo[20582]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:38:48.103201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:48.168653 n-d-760454-3 sudo[20582]: pam_unix(sudo:session): session closed for user root
Jan 25 14:38:48.170692 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.532s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:38:48.172925 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:38:49.107901 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:50.113815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:51.119307 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:52.125012 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:53.130346 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:54.135372 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:55.142195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:56.148109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:57.153578 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:58.159732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:38:59.165387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:00.171862 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:01.177303 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:02.182991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:03.188741 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:04.194437 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:05.200312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:06.244922 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:07.211906 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:08.217049 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:09.222921 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:10.228573 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:11.235333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:12.241894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:13.251382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:14.253663 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:15.258380 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:16.263542 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:17.269466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:18.274495 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:19.280092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:20.284883 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:21.289965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:22.297201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:23.302996 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:24.308245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:25.313788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:26.320149 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:27.324997 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:28.331073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:29.336195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:30.341858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:31.346551 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:32.351759 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:33.357666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:34.362839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:35.368479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:36.374605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:37.380208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:38.385972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:39.391454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:40.397401 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:41.402913 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:42.408550 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:43.413947 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:44.419728 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:45.425442 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:46.431317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:47.269542 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:39:47.271358 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:39:47.271358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:39:47.287171 n-d-760454-3 sudo[20617]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:39:47.287794 n-d-760454-3 sudo[20617]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:39:47.441251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:47.635805 n-d-760454-3 sudo[20617]: pam_unix(sudo:session): session closed for user root
Jan 25 14:39:47.637684 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:39:47.638952 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:39:47.655079 n-d-760454-3 sudo[20621]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:39:47.655608 n-d-760454-3 sudo[20621]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:39:48.241652 n-d-760454-3 sudo[20621]: pam_unix(sudo:session): session closed for user root
Jan 25 14:39:48.243841 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:39:48.244774 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:39:48.450475 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:49.453583 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:50.459284 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:51.473714 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:52.471419 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:53.476214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:54.481236 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:55.487076 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:56.492697 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:57.498246 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:58.502967 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:39:59.508402 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:00.513939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:01.519602 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:02.526076 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:03.531501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:04.538069 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:05.543942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:06.549886 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:07.555393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:08.561097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:09.566248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:10.571750 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:11.577688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:12.583922 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:13.589770 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:14.594601 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:15.600744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:16.606009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:17.611286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:18.617062 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:19.622978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:20.628607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:21.633950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:22.639743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:23.646479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:24.651729 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:25.657382 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:26.667772 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:27.672759 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:28.678236 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:29.683754 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:30.689640 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:31.695525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:32.701280 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:33.707687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:34.713608 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:35.718877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:36.724510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:37.730098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:38.735952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:39.741373 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:40.747063 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:41.753139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:42.758771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:43.764344 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:44.769904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:45.775022 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:46.780203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:47.271782 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:40:47.272374 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:40:47.273446 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:40:47.291126 n-d-760454-3 sudo[20642]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:40:47.291697 n-d-760454-3 sudo[20642]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:40:47.641287 n-d-760454-3 sudo[20642]: pam_unix(sudo:session): session closed for user root
Jan 25 14:40:47.644063 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:40:47.645333 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:40:47.661963 n-d-760454-3 sudo[20646]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:40:47.662543 n-d-760454-3 sudo[20646]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:40:47.787767 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:48.188973 n-d-760454-3 sudo[20646]: pam_unix(sudo:session): session closed for user root
Jan 25 14:40:48.191339 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.546s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:40:48.192189 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:40:48.794031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:49.799842 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:50.805858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:51.811241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:52.816897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:53.822265 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:54.828164 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:55.833533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:56.839287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:57.844865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:58.850779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:40:59.856394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:00.861041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:01.865808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:02.871308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:03.876948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:04.883439 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:05.889282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:06.894783 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:07.902098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:08.907327 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:09.913076 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:10.918847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:11.924929 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:12.930132 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:13.935844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:14.941481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:15.947410 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:16.953091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:17.959182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:18.965414 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:19.971492 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:20.976183 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:21.981914 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:22.987505 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:23.995026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:25.000692 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:26.006033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:27.012290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:28.017944 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:29.023141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:30.029041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:31.034422 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:32.039972 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:33.046213 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:34.051127 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:35.056661 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:36.062476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:37.068071 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:38.072958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:39.078449 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:40.084660 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:41.090315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:42.096199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:43.101262 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:44.107470 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:45.114527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:46.120171 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:47.124937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:47.268099 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:41:47.268489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:41:47.269381 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:41:47.286808 n-d-760454-3 sudo[20664]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:41:47.287350 n-d-760454-3 sudo[20664]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:41:47.630831 n-d-760454-3 sudo[20664]: pam_unix(sudo:session): session closed for user root
Jan 25 14:41:47.632996 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.363s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:41:47.634342 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:41:47.650655 n-d-760454-3 sudo[20668]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:41:47.651164 n-d-760454-3 sudo[20668]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:41:48.133064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:48.257122 n-d-760454-3 sudo[20668]: pam_unix(sudo:session): session closed for user root
Jan 25 14:41:48.259012 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:41:48.259812 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:41:49.138741 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:50.144284 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:51.149085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:52.154986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:53.160723 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:54.167700 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:55.175131 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:56.182701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:57.188383 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:58.195077 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:41:59.200565 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:00.206600 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:01.213479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:02.220102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:03.225260 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:04.230513 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:05.235621 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:06.240675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:06.933636 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-d7f5a4e7-e561-4820-8f52-9e8c212510fe req-ef1b2cda-2729-4027-83ec-4354b53368d8 tempest-TestShelveInstance-1736033758 None] Terminate volume connection completed successfully.
Jan 25 14:42:06.935240 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-d7f5a4e7-e561-4820-8f52-9e8c212510fe req-ef1b2cda-2729-4027-83ec-4354b53368d8 tempest-TestShelveInstance-1736033758 None] Deleting attachment 36f3b01c-550e-4637-b1d8-caaa575bbc51. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:42:07.069676 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-d7f5a4e7-e561-4820-8f52-9e8c212510fe req-ef1b2cda-2729-4027-83ec-4354b53368d8 tempest-TestShelveInstance-1736033758 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:42:07.069676 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:42:07.069676 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:42:07.248135 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:08.253930 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:09.259603 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:10.283130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:10.284876 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:10.301738 n-d-760454-3 sudo[20678]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:10.302287 n-d-760454-3 sudo[20678]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:42:10.651571 n-d-760454-3 sudo[20678]: pam_unix(sudo:session): session closed for user root
Jan 25 14:42:10.654011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.369s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:10.703736 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:10.709511 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.006s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:10.709939 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Targets prior to update: Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         UQytHanxCpxeEfJjcEW4
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:42:10.710644 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:127}}
Jan 25 14:42:10.714180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Creating iscsi_target for Volume ID: volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:147}}
Jan 25 14:42:10.714180 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Persistence file already exists for volume, found file at: /opt/stack/data/cinder/volumes/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:153}}
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Created volume path /opt/stack/data/cinder/volumes/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034,
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]: content:
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]: <target iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034>
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:     backing-store /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:     driver iscsi
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:     incominguser UQytHanxCpxeEfJjcEW4 A3gQKkj6P7n5Vu6P
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:     
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:     write-cache on
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]: </target>
Jan 25 14:42:10.772116 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:157}}
Jan 25 14:42:10.773531 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --update iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:11.160011 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --update iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.386s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:11.160386 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:42:11.161049 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] StdOut from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:113}}
Jan 25 14:42:11.161457 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] StdErr from tgt-admin --update:  {{(pid=89244) _do_tgt_update /opt/stack/cinder/cinder/volume/targets/tgt.py:114}}
Jan 25 14:42:11.162864 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgtadm --lld iscsi --op show --mode target {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:11.168464 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgtadm --lld iscsi --op show --mode target" returned: 0 in 0.005s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:11.168994 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.tgt [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Targets after update: Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:     System information:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         Driver: iscsi
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         State: ready
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:     I_T nexus information:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:     LUN information:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         LUN: 0
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Type: controller
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010000
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf10
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Size: 0 MB, Block size: 1
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store type: null
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store path: None
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         LUN: 1
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Type: disk
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SCSI ID: IET     00010001
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SCSI SN: beaf11
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Size: 1074 MB, Block size: 512
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Online: Yes
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Removable media: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Prevent removal: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Readonly: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             SWP: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Thin-provisioning: No
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store type: rdwr
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:             Backing store flags:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:     Account information:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         UQytHanxCpxeEfJjcEW4
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:     ACL information:
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:         ALL
Jan 25 14:42:11.169683 n-d-760454-3 cinder-volume[89138]:  {{(pid=89244) create_iscsi_target /opt/stack/cinder/cinder/volume/targets/tgt.py:195}}
Jan 25 14:42:11.173375 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:11.251752 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.080s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:11.252143 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:42:11.253609 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:11.289483 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:11.332299 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:11.332709 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139701043623328]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:42:11.333747 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.targets.iscsi [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] Set provider_location to: 10.222.0.65:3260,1 iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 1 {{(pid=89244) create_export /opt/stack/cinder/cinder/volume/targets/iscsi.py:204}}
Jan 25 14:42:11.683261 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-db8dd221-8a21-44c3-bf37-cfcc9e81d9f3 req-d7c75534-870f-4cde-bc52-ad61e92cd8f8 tempest-TestShelveInstance-1736033758 None] attachment_update completed successfully.
Jan 25 14:42:12.295765 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:13.301351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:14.307840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:15.313533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:16.319465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:17.324734 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:18.331053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:19.336409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:20.342076 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:21.356338 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:22.355691 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:23.360871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:24.366491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:25.372575 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:26.378409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:27.384196 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:28.390073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:29.397613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:30.402514 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:31.408119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:32.414349 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:33.420458 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:34.426109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:35.431244 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:36.437112 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:37.460230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:38.449463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:39.455266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:40.460163 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:41.466627 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:42.475177 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:43.481976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:44.487481 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:45.489860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:46.494951 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:47.269378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:42:47.269378 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:42:47.269378 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:47.284955 n-d-760454-3 sudo[20733]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:42:47.285496 n-d-760454-3 sudo[20733]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:42:47.501970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:47.639228 n-d-760454-3 sudo[20733]: pam_unix(sudo:session): session closed for user root
Jan 25 14:42:47.641039 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:47.642319 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:42:47.658924 n-d-760454-3 sudo[20737]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:42:47.659456 n-d-760454-3 sudo[20737]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:42:48.353893 n-d-760454-3 sudo[20737]: pam_unix(sudo:session): session closed for user root
Jan 25 14:42:48.356409 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:42:48.357722 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:42:48.509605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:49.515355 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:50.521109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:51.527071 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:52.532492 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:53.537648 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:54.543213 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:55.549239 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:56.554649 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:57.560991 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:58.566788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:42:59.573427 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:00.579305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:01.584847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:02.590317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:03.596928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:04.603086 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:05.608595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:06.615327 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:07.620939 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:08.626764 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:09.632888 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:10.638369 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:11.644142 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:12.650097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:13.655510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:14.660132 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:15.666138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:16.671993 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:17.677112 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:18.682695 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:19.688514 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:20.694799 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:21.700714 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:22.706490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:23.712566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:24.718160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:25.724719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:26.730920 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:27.736019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:28.741876 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:29.747609 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:30.753074 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:31.758789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:32.764935 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:33.770945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:34.776707 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:35.784952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:36.787746 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:37.793454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:38.799268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:39.805180 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:40.811676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:41.817973 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:42.824667 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:43.830607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:44.836322 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:45.841350 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:46.847849 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:47.266608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:43:47.267093 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:43:47.267908 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:43:47.284000 n-d-760454-3 sudo[20757]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:43:47.284554 n-d-760454-3 sudo[20757]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:43:47.631520 n-d-760454-3 sudo[20757]: pam_unix(sudo:session): session closed for user root
Jan 25 14:43:47.633687 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.365s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:43:47.635029 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:43:47.652118 n-d-760454-3 sudo[20761]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:43:47.652740 n-d-760454-3 sudo[20761]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:43:47.855105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:48.331585 n-d-760454-3 sudo[20761]: pam_unix(sudo:session): session closed for user root
Jan 25 14:43:48.334083 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:43:48.335075 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:43:48.860989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:49.867033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:50.873076 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:51.879607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:52.885475 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:53.890877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:54.896872 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:55.901773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:56.907713 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:57.912925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:58.918615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:43:59.924477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:00.936291 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:01.941167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:02.947017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:03.952454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:04.957976 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:05.963441 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:06.969051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:07.973825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:08.979506 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:09.985040 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:10.989952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:11.994941 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:13.000673 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:14.006027 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:15.011827 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:16.017961 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:17.022830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:18.029110 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:19.034955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:20.040558 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:21.045719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:22.052149 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:23.057781 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:24.063577 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:25.069711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:26.075085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:27.081665 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:28.088661 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:29.094082 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:30.100224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:31.106361 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:32.111212 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:33.116959 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:34.121886 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:35.127368 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:36.133085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:36.287952 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-3c220b6e-5eb7-436b-a5ad-a25314571933 tempest-TestShelveInstance-1736033758 None] Terminate volume connection completed successfully.
Jan 25 14:44:36.288307 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.manager [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-3c220b6e-5eb7-436b-a5ad-a25314571933 tempest-TestShelveInstance-1736033758 None] Deleting attachment 87bb52f5-9dc9-4bf9-abdd-78dc1ada0143. {{(pid=89244) _do_attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4680}}
Jan 25 14:44:36.290230 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:36.368100 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:36.368520 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('Target 1: iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n    System information:\n        Driver: iscsi\n        State: ready\n    I_T nexus information:\n    LUN information:\n        LUN: 0\n            Type: controller\n            SCSI ID: IET     00010000\n            SCSI SN: beaf10\n            Size: 0 MB, Block size: 1\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: null\n            Backing store path: None\n            Backing store flags: \n        LUN: 1\n            Type: disk\n            SCSI ID: IET     00010001\n            SCSI SN: beaf11\n            Size: 1074 MB, Block size: 512\n            Online: Yes\n            Removable media: No\n            Prevent removal: No\n            Readonly: No\n            SWP: No\n            Thin-provisioning: No\n            Backing store type: rdwr\n            Backing store path: /dev/stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034\n            Backing store flags: \n    Account information:\n        UQytHanxCpxeEfJjcEW4\n    ACL information:\n        ALL\n', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:44:36.369268 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.tgt [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-3c220b6e-5eb7-436b-a5ad-a25314571933 tempest-TestShelveInstance-1736033758 None] Removing iscsi_target for Volume ID: 1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:36.370475 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --delete iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 -f {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:36.509283 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --delete iqn.2010-10.org.openstack:volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 -f" returned: 0 in 0.138s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:36.509733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, None) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:44:36.511100 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:36.590512 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.079s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:36.590905 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:44:36.716227 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-3c220b6e-5eb7-436b-a5ad-a25314571933 tempest-TestShelveInstance-1736033758 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:44:36.716227 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:44:36.716227 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:44:37.034776 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Lock "b'cinder-1c635e62-daf0-4fd9-af1a-45d9e3de5034-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:150}}
Jan 25 14:44:37.149003 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:37.151362 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tgt-admin --show {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:37.230145 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [-] CMD "tgt-admin --show" returned: 0 in 0.078s {{(pid=97445) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:37.230525 n-d-760454-3 cinder-volume[89138]: DEBUG oslo.privsep.daemon [-] privsep: reply[139700513357448]: (4, ('', '')) {{(pid=97445) _call_back /usr/local/lib/python3.6/dist-packages/oslo_privsep/daemon.py:511}}
Jan 25 14:44:37.231300 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.targets.iscsi [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Skipping remove_export. No iscsi_target is presently exported for volume: 1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:37.232169 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:37.248095 n-d-760454-3 sudo[20816]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:37.248725 n-d-760454-3 sudo[20816]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:37.799848 n-d-760454-3 sudo[20816]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:37.802343 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.570s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:37.803598 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:37.820133 n-d-760454-3 sudo[20820]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:37.820871 n-d-760454-3 sudo[20820]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:38.157193 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:38.175541 n-d-760454-3 sudo[20820]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:38.177411 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvdisplay --noheading -C -o Attr stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.374s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:38.179261 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:38.195628 n-d-760454-3 sudo[20824]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:38.196199 n-d-760454-3 sudo[20824]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:38.747227 n-d-760454-3 sudo[20824]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:38.749608 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvremove --config activation { retry_deactivation = 1}  -f stack-volumes-lvmdriver-1/volume-1c635e62-daf0-4fd9-af1a-45d9e3de5034" returned: 0 in 0.570s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:38.750860 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.drivers.lvm [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Successfully deleted volume: 1c635e62-daf0-4fd9-af1a-45d9e3de5034
Jan 25 14:44:38.839372 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.quota [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Created reservations ['4fdf28b3-ef9a-4121-847e-2a71b1444ee8', 'f46b006a-05b6-4d9d-aaa9-6e2b64e6c24a', '8af185dd-ee79-4d41-bbb9-a35984eabc8f', '1a9c32c6-b3db-4d5a-b07a-f8ab0e14081c'] {{(pid=89244) reserve /opt/stack/cinder/cinder/quota.py:1036}}
Jan 25 14:44:38.841924 n-d-760454-3 cinder-volume[89138]: WARNING py.warnings [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] /usr/local/lib/python3.6/dist-packages/sqlalchemy/orm/evaluator.py:99: SAWarning: Evaluating non-mapped column expression 'updated_at' onto ORM instances; this is a deprecated use case.  Please make use of the actual mapped columns in ORM-evaluated UPDATE / DELETE expressions.
Jan 25 14:44:38.841924 n-d-760454-3 cinder-volume[89138]:   "UPDATE / DELETE expressions." % clause
Jan 25 14:44:38.841924 n-d-760454-3 cinder-volume[89138]: 
Jan 25 14:44:38.958734 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:44:38.959532 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:38.977417 n-d-760454-3 sudo[20833]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:44:38.978104 n-d-760454-3 sudo[20833]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:39.167064 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:39.355723 n-d-760454-3 sudo[20833]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:39.357605 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.398s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:39.359148 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:39.376167 n-d-760454-3 sudo[20839]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:44:39.377445 n-d-760454-3 sudo[20839]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:39.909283 n-d-760454-3 sudo[20839]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:39.911848 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:39.913754 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:44:39.919900 n-d-760454-3 cinder-volume[89138]: INFO cinder.volume.manager [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Deleted volume successfully.
Jan 25 14:44:39.977009 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.coordination [req-2ce1e2cc-a1be-4433-9051-641e35519e71 req-763ae66e-f2fc-4edc-9d63-43664c8d655e tempest-TestShelveInstance-1736033758 None] Lock "b'cinder-1c635e62-daf0-4fd9-af1a-45d9e3de5034-delete_volume'" released by "delete_volume" :: held 2.942s {{(pid=89244) _synchronized /opt/stack/cinder/cinder/coordination.py:162}}
Jan 25 14:44:40.173718 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:41.179249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:42.184161 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:43.189261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:44.194471 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:45.200037 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:46.206537 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:47.211834 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:47.266921 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:44:47.267323 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:44:47.268133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:47.285781 n-d-760454-3 sudo[20881]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:44:47.286336 n-d-760454-3 sudo[20881]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:47.688616 n-d-760454-3 sudo[20881]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:47.690733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:47.691959 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:44:47.708715 n-d-760454-3 sudo[20885]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:44:47.709251 n-d-760454-3 sudo[20885]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:44:48.219040 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:48.249653 n-d-760454-3 sudo[20885]: pam_unix(sudo:session): session closed for user root
Jan 25 14:44:48.251486 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:44:48.252393 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:44:49.226133 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:50.232183 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:51.238523 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:52.243749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:53.249279 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:54.254766 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:55.260394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:56.266671 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:57.273326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:58.279543 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:44:59.285488 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:00.292004 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:01.297096 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:02.313916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:03.309693 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:04.315680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:05.320917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:06.326923 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:07.333058 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:08.338320 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:09.345277 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:10.350230 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:11.361140 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:12.367281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:13.373172 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:14.380097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:15.387285 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:16.393267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:17.399203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:18.409552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:19.415276 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:20.420966 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:21.427725 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:22.433268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:23.439997 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:24.445576 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:25.450297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:26.455699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:27.461641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:28.467275 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:29.473905 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:30.478715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:31.484220 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:32.490393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:33.495949 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:34.501555 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:35.507091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:36.512742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:37.518351 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:38.524501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:39.530338 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:40.536092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:41.541426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:42.547160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:43.552970 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:44.559399 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:45.564545 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:46.570453 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:47.269481 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:45:47.269800 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:45:47.270601 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:45:47.288252 n-d-760454-3 sudo[21261]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:45:47.288819 n-d-760454-3 sudo[21261]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:45:47.577713 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:47.659221 n-d-760454-3 sudo[21261]: pam_unix(sudo:session): session closed for user root
Jan 25 14:45:47.661186 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:45:47.662361 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:45:47.679250 n-d-760454-3 sudo[21265]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:45:47.679782 n-d-760454-3 sudo[21265]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:45:48.258532 n-d-760454-3 sudo[21265]: pam_unix(sudo:session): session closed for user root
Jan 25 14:45:48.261266 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:45:48.262192 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:45:48.585073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:49.591503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:50.596486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:51.602426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:52.608874 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:53.614533 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:54.620408 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:55.626448 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:56.632839 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:57.638134 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:58.643379 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:45:59.648486 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:00.654698 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:01.660123 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:02.665735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:03.671161 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:04.677624 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:05.683377 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:06.689167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:07.695024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:08.701375 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:09.707150 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:10.713118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:11.719250 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:12.724911 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:13.731199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:14.736954 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:15.741919 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:16.747675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:17.753078 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:18.758547 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:19.764404 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:20.769805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:21.775314 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:22.780736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:23.786219 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:24.798665 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:25.803870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:26.809872 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:27.815987 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:28.821688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:29.828302 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:30.834200 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:31.839866 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:32.846282 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:33.851685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:34.858082 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:35.863613 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:36.869737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:37.875454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:38.881615 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:39.887162 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:40.893588 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:41.899000 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:42.904904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:43.911017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:44.917021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:45.922924 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:46.929317 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:47.269461 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:46:47.269860 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:46:47.270660 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:46:47.287529 n-d-760454-3 sudo[21287]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:46:47.288135 n-d-760454-3 sudo[21287]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:46:47.671283 n-d-760454-3 sudo[21287]: pam_unix(sudo:session): session closed for user root
Jan 25 14:46:47.673429 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.402s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:46:47.674976 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:46:47.691135 n-d-760454-3 sudo[21291]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:46:47.691707 n-d-760454-3 sudo[21291]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:46:47.937119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:48.280507 n-d-760454-3 sudo[21291]: pam_unix(sudo:session): session closed for user root
Jan 25 14:46:48.282307 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:46:48.283104 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:46:48.943253 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:49.949225 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:50.954666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:51.960421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:52.965657 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:53.971315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:54.976642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:55.982670 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:56.988361 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:57.994422 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:46:59.000237 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:00.006833 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:01.012904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:02.017994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:03.024261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:04.029949 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:05.035530 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:06.041568 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:07.047904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:08.054130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:09.058937 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:10.064743 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:11.071137 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:12.076922 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:13.081957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:14.087241 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:15.092423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:16.097069 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:17.102781 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:18.108499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:19.113977 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:20.120564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:21.126119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:22.131700 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:23.137099 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:24.142684 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:25.148335 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:26.154913 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:27.159737 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:28.165074 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:29.171690 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:30.177467 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:31.183849 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:32.188947 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:33.194843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:34.200785 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:35.205857 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:36.210962 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:37.216642 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:38.221763 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:39.227203 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:40.232608 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:41.239030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:42.244644 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:43.250024 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:44.255670 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:45.261156 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:46.266722 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:47.270185 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:47:47.270755 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:47:47.271358 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:47:47.287259 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:47.287842 n-d-760454-3 sudo[21311]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:47:47.288386 n-d-760454-3 sudo[21311]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:47:47.658319 n-d-760454-3 sudo[21311]: pam_unix(sudo:session): session closed for user root
Jan 25 14:47:47.660096 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.389s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:47:47.661289 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:47:47.677399 n-d-760454-3 sudo[21315]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:47:47.678048 n-d-760454-3 sudo[21315]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:47:48.200497 n-d-760454-3 sudo[21315]: pam_unix(sudo:session): session closed for user root
Jan 25 14:47:48.202726 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:47:48.205439 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:47:48.293665 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:49.298745 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:50.304309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:51.308953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:52.315268 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:53.320698 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:54.326605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:55.332223 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:56.337840 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:57.343739 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:58.349384 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:47:59.354342 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:00.364001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:01.369649 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:02.374871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:03.380471 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:04.385716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:05.391243 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:06.397209 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:07.403092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:08.410095 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:09.416319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:10.421092 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:11.427877 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:12.433863 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:13.440316 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:14.447226 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:15.452266 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:16.458170 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:17.463397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:18.469594 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:19.475345 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:20.480835 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:21.486365 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:22.491953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:23.497858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:24.504715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:25.510490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:26.524299 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:27.531925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:28.539011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:29.544812 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:30.550978 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:31.558666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:32.564764 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:33.570043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:34.575372 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:35.580677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:36.587571 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:37.593210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:38.600393 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:39.606331 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:40.612685 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:41.621139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:42.627567 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:43.634027 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:44.643101 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:45.648749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:46.655049 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:47.270119 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:48:47.270455 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:48:47.271263 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:48:47.306245 n-d-760454-3 sudo[21377]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:48:47.306791 n-d-760454-3 sudo[21377]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:48:47.663529 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:48.059418 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.784s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:48:48.059418 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:48:48.053230 n-d-760454-3 sudo[21377]: pam_unix(sudo:session): session closed for user root
Jan 25 14:48:48.073565 n-d-760454-3 sudo[21383]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:48:48.074147 n-d-760454-3 sudo[21383]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:48:48.671427 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:49.305761 n-d-760454-3 sudo[21383]: pam_unix(sudo:session): session closed for user root
Jan 25 14:48:49.307702 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.251s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:48:49.308509 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:48:49.677185 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:50.682902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:51.688711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:52.694407 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:53.700128 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:54.705854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:55.711873 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:56.717926 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:57.723703 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:58.729249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:48:59.735333 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:00.740925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:01.745716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:02.751305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:03.756882 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:04.763187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:05.769271 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:06.774115 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:07.779814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:08.784658 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:09.790226 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:10.795341 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:11.801436 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:12.806681 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:13.812045 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:14.818323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:15.823755 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:16.829827 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:17.835926 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:18.841798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:19.847915 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:20.853091 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:21.858780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:22.865494 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:23.870981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:24.877703 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:25.884491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:26.890041 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:27.896119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:28.901099 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:29.907138 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:30.912890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:31.918753 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:32.924145 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:33.929798 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:34.935405 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:35.941706 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:36.947193 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:37.952860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:38.958534 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:39.964232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:40.969999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:41.975931 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:42.981666 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:43.987358 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:44.992990 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:45.999214 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:47.004802 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:48.010485 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:49.016068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:50.023526 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:51.029712 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:52.035563 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:53.041454 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:54.047396 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:55.053427 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:56.059397 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:57.065450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:58.071422 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:49:59.077283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:00.083425 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:01.089098 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:02.094683 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:03.100703 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:04.106293 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:05.112376 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:06.117566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:07.123495 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:08.129074 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:09.134807 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:10.140421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:11.145640 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:12.150278 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:13.156566 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:14.162224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:15.167938 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:16.173028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:17.178901 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:18.184592 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:19.190843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:20.196806 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:21.202385 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:22.207760 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:23.213224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:24.219261 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:25.224152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:26.230431 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:27.235981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:28.241073 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:29.246448 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:30.252747 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:31.258943 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:32.268018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:33.275917 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:34.280981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:35.288479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:36.297413 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:37.305461 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:38.312009 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:39.317706 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:40.323831 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:41.329871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:42.335592 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:43.341818 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:44.347083 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:45.353845 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:46.360708 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:47.277579 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:50:47.277982 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:50:47.279314 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:50:47.296469 n-d-760454-3 sudo[21432]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:50:47.297134 n-d-760454-3 sudo[21432]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:50:47.368283 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:47.720067 n-d-760454-3 sudo[21432]: pam_unix(sudo:session): session closed for user root
Jan 25 14:50:47.721846 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:50:47.723047 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:50:47.739843 n-d-760454-3 sudo[21436]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:50:47.740974 n-d-760454-3 sudo[21436]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:50:48.348025 n-d-760454-3 sudo[21436]: pam_unix(sudo:session): session closed for user root
Jan 25 14:50:48.351619 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:50:48.352489 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:50:48.376945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:49.382232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:50.387904 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:51.393587 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:52.399008 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:53.405128 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:54.410815 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:55.416379 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:56.423499 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:57.430493 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:58.436020 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:50:59.441723 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:00.447291 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:01.453020 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:02.458757 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:03.464288 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:04.471503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:05.478049 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:06.484842 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:07.491751 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:08.498529 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:09.504217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:10.510118 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:11.516121 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:12.521036 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:13.526406 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:14.532491 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:15.538033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:16.544388 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:17.549050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:18.554403 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:19.560182 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:20.565732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:21.571305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:22.576768 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:23.582986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:24.588800 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:25.594781 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:26.600021 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:27.606189 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:28.611814 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:29.617525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:30.623355 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:31.629031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:32.634881 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:33.640305 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:34.646192 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:35.652087 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:36.657870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:37.663668 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:38.668396 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:39.672993 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:40.678856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:41.684876 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:42.690448 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:43.696237 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:44.701957 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:45.707474 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:46.713166 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:47.280775 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:51:47.281101 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:51:47.281930 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:51:47.298061 n-d-760454-3 sudo[21543]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:51:47.298608 n-d-760454-3 sudo[21543]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:51:47.682997 n-d-760454-3 sudo[21543]: pam_unix(sudo:session): session closed for user root
Jan 25 14:51:47.685771 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.403s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:51:47.687041 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:51:47.703740 n-d-760454-3 sudo[21547]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:51:47.704353 n-d-760454-3 sudo[21547]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:51:47.720589 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:48.268040 n-d-760454-3 sudo[21547]: pam_unix(sudo:session): session closed for user root
Jan 25 14:51:48.269880 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:51:48.270683 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:51:48.725948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:49.732810 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:50.737799 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:51.743141 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:52.748616 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:53.754287 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:54.759900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:55.766851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:56.773081 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:57.778444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:58.784281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:51:59.789215 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:00.795276 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:01.801065 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:02.806893 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:03.813046 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:04.820198 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:05.825388 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:06.830915 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:07.837050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:08.842783 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:09.848293 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:10.853875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:11.859527 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:12.865011 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:13.870998 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:14.881641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:15.887719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:16.894216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:17.899960 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:18.906623 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:19.913506 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:20.919206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:21.925208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:23.164222 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:23.937928 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:24.945296 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:25.951843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:26.957247 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:27.962383 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:28.967871 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:29.973541 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:30.979079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:31.984860 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:32.990418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:33.995206 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:35.001718 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:36.008489 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:37.013953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:38.019614 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:39.024443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:40.030927 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:41.036762 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:42.042198 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:43.048119 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:44.053715 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:45.058869 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:46.064187 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:47.069788 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:47.277054 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:52:47.277351 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:52:47.278457 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:52:47.295309 n-d-760454-3 sudo[21567]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:52:47.295887 n-d-760454-3 sudo[21567]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:52:47.662639 n-d-760454-3 sudo[21567]: pam_unix(sudo:session): session closed for user root
Jan 25 14:52:47.664747 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:52:47.665965 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:52:47.682025 n-d-760454-3 sudo[21571]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:52:47.682594 n-d-760454-3 sudo[21571]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:52:48.077075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:48.258380 n-d-760454-3 sudo[21571]: pam_unix(sudo:session): session closed for user root
Jan 25 14:52:48.260157 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:52:48.261030 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:52:49.082688 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:50.088795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:51.094892 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:52.100523 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:53.105969 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:54.111267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:55.116519 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:56.122362 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:57.128521 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:58.134444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:52:59.140044 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:00.145677 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:01.150636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:02.155503 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:03.161470 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:04.167031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:05.172771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:06.178312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:07.184109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:08.189952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:09.196205 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:10.204578 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:11.207934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:12.213742 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:13.220018 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:14.225160 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:15.230617 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:16.237051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:17.242801 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:18.248409 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:19.253808 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:20.259816 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:21.264954 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:22.270929 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:23.276179 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:24.283420 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:25.289083 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:26.294803 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:27.300634 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:28.306716 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:29.312384 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:30.317875 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:31.323403 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:32.329476 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:33.334713 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:34.340030 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:35.345676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:36.351948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:37.358865 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:38.364512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:39.370407 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:40.375898 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:41.381825 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:42.387641 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:43.394013 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:44.399601 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:45.405444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:46.411292 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:47.278133 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:53:47.278473 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:53:47.279321 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:53:47.295954 n-d-760454-3 sudo[21587]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:53:47.296585 n-d-760454-3 sudo[21587]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:53:47.418977 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:47.674898 n-d-760454-3 sudo[21587]: pam_unix(sudo:session): session closed for user root
Jan 25 14:53:47.676733 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:53:47.678164 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:53:47.694537 n-d-760454-3 sudo[21591]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:53:47.695145 n-d-760454-3 sudo[21591]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:53:48.235400 n-d-760454-3 sudo[21591]: pam_unix(sudo:session): session closed for user root
Jan 25 14:53:48.237564 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:53:48.238426 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:53:48.425763 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:49.431245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:50.436853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:51.442942 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:52.448252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:53.453426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:54.459101 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:55.464465 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:56.470675 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:57.476016 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:58.481102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:53:59.485830 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:00.491126 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:01.496130 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:02.500785 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:03.506518 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:04.511964 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:05.517719 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:06.523952 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:07.529336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:08.535151 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:09.540475 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:10.546139 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:11.550971 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:12.557394 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:13.562974 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:14.568332 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:15.574166 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:16.579489 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:17.585102 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:18.591293 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:19.596423 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:20.602027 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:21.607581 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:22.613188 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:23.618779 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:24.624329 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:25.629897 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:26.636792 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:27.641513 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:28.647258 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:29.653421 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:30.658900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:31.664224 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:32.670306 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:33.675916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:34.681308 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:35.688335 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:36.693853 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:37.698898 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:38.705251 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:39.709941 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:40.715780 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:41.721398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:42.726868 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:43.732644 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:44.738210 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:45.743195 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:46.749387 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:47.274841 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:54:47.275242 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:54:47.276046 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:54:47.292056 n-d-760454-3 sudo[21607]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:54:47.292712 n-d-760454-3 sudo[21607]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:54:47.675306 n-d-760454-3 sudo[21607]: pam_unix(sudo:session): session closed for user root
Jan 25 14:54:47.678167 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:54:47.680018 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:54:47.696484 n-d-760454-3 sudo[21611]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:54:47.697149 n-d-760454-3 sudo[21611]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:54:47.756652 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:48.263902 n-d-760454-3 sudo[21611]: pam_unix(sudo:session): session closed for user root
Jan 25 14:54:48.265694 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:54:48.266485 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:54:48.762773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:49.768810 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:50.774310 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:51.779910 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:52.785329 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:53.790868 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:54.796789 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:55.801749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:56.808032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:57.813817 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:58.819819 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:54:59.825451 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:00.831446 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:01.837120 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:02.842032 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:03.847595 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:04.853297 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:05.858290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:06.864366 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:07.869955 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:08.876575 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:09.881626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:10.887201 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:11.893598 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:12.900310 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:13.905981 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:14.911248 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:15.916773 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:16.924447 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:17.931117 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:18.935750 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:19.941083 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:20.946813 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:21.952867 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:22.958324 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:23.963381 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:24.969026 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:25.974190 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:26.980068 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:27.985672 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:28.991483 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:29.997480 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:31.003252 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:32.009194 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:33.014751 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:34.021477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:35.027492 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:36.034196 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:37.039912 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:38.044987 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:39.051564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:40.057560 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:41.062711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:42.068462 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:43.074093 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:44.079620 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:45.085776 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:46.093075 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:47.099627 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:47.273226 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:55:47.273725 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:55:47.274549 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:55:47.292276 n-d-760454-3 sudo[21627]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:55:47.292913 n-d-760454-3 sudo[21627]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:55:47.688826 n-d-760454-3 sudo[21627]: pam_unix(sudo:session): session closed for user root
Jan 25 14:55:47.691037 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:55:47.692265 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:55:47.709847 n-d-760454-3 sudo[21631]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:55:47.710510 n-d-760454-3 sudo[21631]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:55:48.107028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:48.243754 n-d-760454-3 sudo[21631]: pam_unix(sudo:session): session closed for user root
Jan 25 14:55:48.245650 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:55:48.247492 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:55:49.112626 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:50.118918 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:51.128108 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:52.135703 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:53.141418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:54.147438 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:55.153053 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:56.158169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:57.163925 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:58.169657 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:55:59.175245 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:00.181340 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:01.187002 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:02.192732 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:03.197618 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:04.202902 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:05.208552 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:06.214370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:07.219805 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:08.224851 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:09.234848 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:10.237003 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:11.243028 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:12.249050 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:13.255434 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:14.261450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:15.267396 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:16.273386 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:17.279004 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:18.284389 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:19.290501 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:20.296999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:21.304097 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:22.309055 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:23.314525 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:24.320771 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:25.326370 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:26.332019 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:27.338231 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:28.346315 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:29.351953 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:30.357847 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:31.363366 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:32.368989 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:33.375025 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:34.380687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:35.385650 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:36.391490 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:37.396941 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:38.402710 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:39.409774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:40.415995 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:41.421822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:42.427398 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:43.434464 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:44.440795 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:45.446510 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:46.452312 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:47.274118 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:56:47.274424 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:56:47.275202 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:56:47.295229 n-d-760454-3 sudo[21648]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:56:47.295806 n-d-760454-3 sudo[21648]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:56:47.460564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:47.695801 n-d-760454-3 sudo[21648]: pam_unix(sudo:session): session closed for user root
Jan 25 14:56:47.697644 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:56:47.698760 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:56:47.716831 n-d-760454-3 sudo[21652]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:56:47.717380 n-d-760454-3 sudo[21652]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:56:48.358176 n-d-760454-3 sudo[21652]: pam_unix(sudo:session): session closed for user root
Jan 25 14:56:48.360432 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:56:48.361360 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:56:48.468095 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:49.473217 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:50.479286 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:51.485659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:52.491325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:53.497298 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:54.502843 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:55.508375 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:56.516017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:57.521644 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:58.527294 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:56:59.533309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:00.537938 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:01.543856 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:02.549330 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:03.555632 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:04.561744 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:05.567426 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:06.573610 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:07.578669 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:08.584254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:09.589786 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:10.595587 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:11.600395 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:12.606472 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:13.612169 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:14.617762 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:15.624133 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:16.630111 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:17.635656 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:18.642403 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:19.648477 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:20.654051 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:21.659822 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:22.664958 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:23.670466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:24.675965 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:25.681676 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:26.688085 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:27.693701 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:28.699579 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:29.705325 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:30.710536 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:31.717249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:32.723605 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:33.729437 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:34.735607 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:35.741344 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:36.747181 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:37.752824 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:38.759433 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:39.764823 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:40.770945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:41.776657 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:42.782487 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:43.788052 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:44.794512 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:45.799974 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:46.806890 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:47.278580 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:57:47.279223 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:57:47.280195 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:57:47.298605 n-d-760454-3 sudo[21670]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:57:47.299179 n-d-760454-3 sudo[21670]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:57:47.667314 n-d-760454-3 sudo[21670]: pam_unix(sudo:session): session closed for user root
Jan 25 14:57:47.670140 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:57:47.671494 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:57:47.687718 n-d-760454-3 sudo[21674]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:57:47.688334 n-d-760454-3 sudo[21674]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:57:47.814934 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:48.161143 n-d-760454-3 sudo[21674]: pam_unix(sudo:session): session closed for user root
Jan 25 14:57:48.163030 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:57:48.163873 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:57:48.820864 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:49.826758 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:50.832213 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:51.838417 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:52.843948 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:53.849461 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:54.855249 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:55.860723 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:56.866757 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:57.872466 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:58.877636 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:57:59.883508 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:00.889164 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:01.894418 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:02.902774 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:03.908618 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:04.916900 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:05.922534 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:06.927866 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:07.934450 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:08.940326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:09.945705 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:10.951319 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:11.957086 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:12.962646 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:13.968389 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:14.973999 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:15.979254 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:16.985039 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:17.990736 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:18.997290 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:20.004323 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:21.009881 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:22.015281 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:23.021088 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:24.026749 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:25.032444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:26.037659 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:27.043479 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:28.049103 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:29.053994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:30.059977 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:31.065661 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:32.071619 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:33.077923 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:34.082746 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:35.088001 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:36.093892 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:37.098628 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:38.104221 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:39.109994 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:40.115735 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:41.122033 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:42.127520 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:43.133014 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:44.139413 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:45.144929 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:46.150663 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:47.156242 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:47.280349 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:58:47.280810 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:58:47.281666 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:58:47.298388 n-d-760454-3 sudo[21690]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:58:47.298991 n-d-760454-3 sudo[21690]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:58:47.685106 n-d-760454-3 sudo[21690]: pam_unix(sudo:session): session closed for user root
Jan 25 14:58:47.687263 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.405s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:58:47.688642 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:58:47.704409 n-d-760454-3 sudo[21694]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:58:47.704992 n-d-760454-3 sudo[21694]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:58:48.164359 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:48.239337 n-d-760454-3 sudo[21694]: pam_unix(sudo:session): session closed for user root
Jan 25 14:58:48.241360 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:58:48.242561 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:58:49.170542 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:50.176152 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:51.181079 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:52.186777 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:53.192216 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:54.197894 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:55.203199 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:56.209585 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:57.215899 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:58.221721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:58:59.227267 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:00.238070 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:01.238975 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:02.244550 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:03.250043 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:04.254842 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:05.261247 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:06.269309 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:07.275232 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:08.281071 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:09.286721 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:10.292915 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:11.298592 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:12.304343 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:13.310194 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:14.315854 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:15.321463 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:16.327445 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:17.333017 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:18.348478 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:19.355147 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:20.360680 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:21.366236 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:22.372373 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:23.378031 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:24.383699 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:25.389109 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:26.394844 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:27.401114 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:28.406167 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:29.411985 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:30.417284 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:31.422705 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:32.428256 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:33.434916 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:34.440564 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:35.445530 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:36.451196 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:37.456829 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:38.463858 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:39.469803 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:40.475687 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:41.482095 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:42.487870 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:43.494105 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:44.499720 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:45.505326 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:46.512950 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:47.280711 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_service.periodic_task [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89244) run_periodic_tasks /usr/local/lib/python3.6/dist-packages/oslo_service/periodic_task.py:211}}
Jan 25 14:59:47.281147 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.volume.drivers.lvm [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Updating volume stats {{(pid=89244) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:214}}
Jan 25 14:59:47.281958 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:59:47.298742 n-d-760454-3 sudo[21712]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jan 25 14:59:47.299311 n-d-760454-3 sudo[21712]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:59:47.520739 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:47.664816 n-d-760454-3 sudo[21712]: pam_unix(sudo:session): session closed for user root
Jan 25 14:59:47.666917 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:59:47.668130 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:384}}
Jan 25 14:59:47.685640 n-d-760454-3 sudo[21727]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jan 25 14:59:47.686209 n-d-760454-3 sudo[21727]: pam_unix(sudo:session): session opened for user root by (uid=0)
Jan 25 14:59:48.304574 n-d-760454-3 sudo[21727]: pam_unix(sudo:session): session closed for user root
Jan 25 14:59:48.307074 n-d-760454-3 cinder-volume[89138]: DEBUG oslo_concurrency.processutils [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=89244) execute /usr/local/lib/python3.6/dist-packages/oslo_concurrency/processutils.py:423}}
Jan 25 14:59:48.307977 n-d-760454-3 cinder-volume[89138]: DEBUG cinder.manager [None req-39801f4f-6a29-4229-bfeb-d572d4e9033a None None] Notifying Schedulers of capabilities ... {{(pid=89244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:192}}
Jan 25 14:59:48.527720 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:49.533336 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:50.538660 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:51.544443 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:52.550208 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:53.556438 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:54.561907 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:55.567711 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:56.573945 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:57.579740 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:58.585207 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 14:59:59.590986 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 15:00:00.596444 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.
Jan 25 15:00:01.602107 n-d-760454-3 cinder-volume[89138]: WARNING tooz.coordination [-] Retrying tooz.drivers.etcd3gw.Etcd3Driver.heartbeat in 1.0 seconds as it raised KeyError: 'TTL'.